-- Logs begin at Tue 2022-10-04 07:59:27 UTC, end at Tue 2022-10-04 09:13:26 UTC. -- Oct 04 08:43:09.232879 dv-cinder-859447-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 08:43:09.241424 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:43:09 2022] *** Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: nodename: dv-cinder-859447-2-iscsi Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: machine: x86_64 Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: clock source: unix Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: pcre jit disabled Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: detected number of CPU cores: 4 Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: current working directory: / Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: your processes number limit is 47680 Oct 04 08:43:09.244155 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: your memory page size is 4096 bytes Oct 04 08:43:09.245145 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: detected max file descriptor number: 2048 Oct 04 08:43:09.245145 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: lock engine: pthread robust mutexes Oct 04 08:43:09.245145 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: thunder lock: enabled Oct 04 08:43:09.245145 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 08:43:09.245145 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:43:09.289704 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: Python main interpreter initialized at 0x561a4d6cb9c0 Oct 04 08:43:09.289704 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: python threads support enabled Oct 04 08:43:09.289704 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: your server socket listen backlog is limited to 100 connections Oct 04 08:43:09.289704 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:43:09.290087 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:43:09.290167 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: *** Operational MODE: preforking *** Oct 04 08:43:09.290383 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:43:09.290383 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: spawned uWSGI master process (pid: 112502) Oct 04 08:43:09.290609 dv-cinder-859447-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 08:43:09.291823 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: spawned uWSGI worker 1 (pid: 112503, cores: 1) Oct 04 08:43:09.291823 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: spawned uWSGI worker 2 (pid: 112504, cores: 1) Oct 04 08:43:09.291823 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:43:09.951508 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:43:09.954308 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:43:11.041163 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:43:11.041163 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: from cryptography.utils import int_from_bytes Oct 04 08:43:11.041801 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:43:11.041801 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: from cryptography.utils import int_from_bytes Oct 04 08:43:11.043423 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:43:11.043423 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: from cryptography.utils import int_from_bytes Oct 04 08:43:11.043843 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:43:11.043843 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: from cryptography.utils import int_from_bytes Oct 04 08:43:13.566339 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:43:13.566912 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:43:13.567010 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:43:13.567361 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:43:13.567444 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:43:13.567535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:43:13.567624 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:43:13.567707 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:43:13.567940 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:43:13.568102 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.568249 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:43:13.568424 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.568575 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.568740 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.568898 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.569054 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.569216 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.569380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.569535 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.569686 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.569862 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.570005 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.570171 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.570319 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.570516 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.570667 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.570836 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.570933 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.571160 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.571261 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.571419 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.571531 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859447-2-iscsi {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.571734 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.571855 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.572056 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859447-2-iscsi {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.572146 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.572382 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.572473 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.572689 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.572782 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.572999 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.573140 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.573317 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.573407 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.573618 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.573711 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.573937 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.574105 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.574249 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.575840 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.575840 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576093 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576201 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576346 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576454 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576550 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576634 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576711 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576787 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.576868 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.577008 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.577104 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.577243 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.577339 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.577560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.577650 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.577865 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.577960 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.578210 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.578336 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859447-2-iscsi {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.578543 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.578660 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.578896 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.578999 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859447-2-iscsi {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.579206 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.579292 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.579532 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.579623 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.579842 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.579945 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.580190 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.580281 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.580505 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.580589 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.580828 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.580918 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.581129 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.581212 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.581448 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.581539 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.581750 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.581845 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.582066 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.582156 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.582378 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.582510 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.582697 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.582786 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.583000 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.583085 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.583304 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.583397 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.583604 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.583694 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.583904 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.584012 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.584204 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.584313 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.584447 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.584532 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.584747 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.584838 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.585019 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.585109 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.585323 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.585418 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.585640 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.585726 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.585895 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.585980 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.586141 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.586260 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.586473 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.586574 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.586772 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.586868 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.587080 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.587169 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.587382 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.587483 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.587681 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.587765 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.587980 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.588070 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.588331 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.588437 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.588572 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.588657 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.588868 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.588951 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.589166 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.589259 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.589467 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.589562 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.589771 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.589857 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.590081 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.590171 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.590379 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.590540 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.590711 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.590803 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.591548 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.591868 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.591961 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.592130 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.592258 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.592441 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.592537 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.592779 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.592863 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.593095 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.593194 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.593400 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.593486 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.593715 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.593799 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.594028 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.594120 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.594329 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.594466 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.594657 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.594745 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.594958 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.595041 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.595258 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.595350 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.595571 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.595664 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.595873 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.595968 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.596121 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.596212 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.596416 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.596500 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.596712 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.596805 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.597010 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.597102 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.597309 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.597398 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.597608 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.597701 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.597906 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.597990 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.598199 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.598288 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.598520 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.598632 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.598819 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.598904 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.599117 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.599212 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.599413 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.599508 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.599709 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.599800 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.600008 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.600092 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.600306 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.600398 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.600602 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.600686 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.600900 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.600983 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.601196 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.601281 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.601492 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.601575 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.601804 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.601895 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.602102 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.602186 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.602439 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.602546 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.602720 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.602805 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.603020 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.603117 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.603319 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.603411 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.603617 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.603708 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.603914 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.604005 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.604211 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.604309 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.604513 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.604605 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.604811 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.604907 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.605109 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.605200 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.605409 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.605493 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.605708 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.605799 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.606007 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.606105 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.606298 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.606388 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.606648 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.606735 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.606962 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.607087 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.607265 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.607361 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.607565 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.607650 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.607863 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.607949 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.608161 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.608254 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.608459 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.608556 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.608761 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.608857 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.609057 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.609151 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.609358 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.609449 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.609652 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.609736 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.609960 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.610057 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.610276 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.610448 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.610621 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.610740 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.610926 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.611044 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.611230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.611346 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.611532 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.611658 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.611848 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:43:13.611993 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.612181 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.612319 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.612511 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.612654 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.612855 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.612950 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.613166 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.613277 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.613496 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.613633 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.613824 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.613909 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.614140 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.614232 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.614471 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.614571 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.614785 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.614870 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.615107 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.615191 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.615411 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.615507 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.615720 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.615804 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.616029 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.616113 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.616338 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.616439 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.616652 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.616742 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.616958 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.617049 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.617269 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.617361 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.617578 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.617662 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.617881 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.617965 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.618188 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.618288 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.618528 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.618616 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.618846 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.618954 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.619149 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.619244 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.619454 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.619548 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.619793 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.619878 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.620108 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.620192 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.620431 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.620515 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.620749 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.620840 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.621102 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.621198 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.621359 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.621444 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.621665 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.621749 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.621975 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.622062 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.622356 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.622474 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.622690 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.622785 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.623005 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.623098 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.623314 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.623398 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.623632 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.623774 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.623941 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.624033 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.624246 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.624331 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.624553 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.624709 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.624863 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.624952 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.625169 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.625254 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.625476 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.625569 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.626047 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.626136 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.626357 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.626484 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.626691 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.626788 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.627000 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.627097 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.627307 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.627390 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.627612 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.627703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.627919 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.628002 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.628223 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.628315 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.628524 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.628610 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.628822 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.628963 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.629117 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.629212 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.629415 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.629502 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.629709 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.629798 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.630005 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.630088 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.630321 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.630426 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.630644 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.630736 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.630959 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.631042 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.631257 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.631347 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.631563 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.631648 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.631867 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.631959 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.632167 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.632256 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.632467 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.632558 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.632772 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.632868 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.633073 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.633157 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.633371 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.633462 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.633670 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.633766 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.633977 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.634061 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.634276 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.634361 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.634601 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.634699 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.634901 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.634986 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.635200 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.635285 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.635500 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.635584 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.635801 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.635884 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.636105 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.636200 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.636406 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.636491 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.636711 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.636795 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.637016 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.637100 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.637319 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.637403 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.637623 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.638207 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.638485 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.638595 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.638820 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.638908 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.639148 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.639244 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.639452 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.639546 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.639776 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.639862 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.640099 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.640191 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.640414 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.640507 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.640714 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.640799 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.641014 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.641105 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.641313 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.641405 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.641608 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.641699 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.641906 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.642040 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.642200 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.642333 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.642534 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.642620 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.642840 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.642925 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.643141 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.643239 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.643436 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.643519 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.643732 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.643815 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.644042 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.644133 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.644341 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.644426 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.644638 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.644728 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.644932 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.645026 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.645228 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.645313 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.645552 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.645635 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.645854 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.645939 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.646192 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.646277 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.646526 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.646625 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.646846 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.646931 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.647155 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.647241 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.647462 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.647558 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.647768 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.647869 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.648072 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.648156 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.648374 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.648466 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.648677 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.648761 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.648984 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.649076 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.649287 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.649379 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.649590 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.649673 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.649892 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.649982 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.650196 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.650284 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.650529 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.650626 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.650836 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.650922 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.651134 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.651218 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.651437 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.651527 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.651748 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.651841 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.652082 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.652167 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.652392 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.652485 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.652708 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.652799 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.653015 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.653100 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.653321 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.653455 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.654201 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.654379 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.654552 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.654719 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.654834 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.655031 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.655125 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.655341 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.655428 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.655658 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.655744 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.655966 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.656049 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.656282 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.656366 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.656588 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.656680 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.656909 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.656993 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.657213 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.657298 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.657523 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.657612 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.657821 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.657905 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.658128 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.658219 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.658473 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.658571 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.658804 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.658897 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.659108 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.659199 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.659414 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.659498 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.659733 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.659825 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.660039 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.660129 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.660343 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.660435 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.660648 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.660740 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.660947 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.661030 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.661246 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.661329 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.661550 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.661642 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.661865 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.661951 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.662169 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.662252 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.662497 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.662594 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.662795 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.662880 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.663103 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.663192 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.663403 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.663488 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.663702 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.663793 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.663999 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.664085 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.664305 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.664398 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.664619 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.664704 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.664924 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.665044 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.665237 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.665329 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.665551 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.665642 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.665848 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.665939 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.666146 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.666232 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.666484 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.666571 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.666790 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.666885 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.667091 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.667175 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.667389 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.667472 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.667689 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.667790 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.668026 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.668147 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.668333 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.668417 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.668631 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.668726 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.668942 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.669098 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.669283 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.669416 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.669587 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.669684 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.669895 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.669982 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.670199 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.670284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.670530 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.670629 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.670848 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.670939 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.671158 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.671242 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.671461 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.671553 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.671765 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.671855 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.672068 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.672151 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.672374 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.672459 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.672677 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.672766 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.672993 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.673078 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.673297 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.673381 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.673597 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.673681 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.673900 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.673991 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.674197 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.674317 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.674523 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.674611 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.674838 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.674934 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.675404 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.675490 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.675733 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.675816 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.676043 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.676135 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.676356 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.676446 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.676692 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.676786 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.677006 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.677100 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.677330 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.677422 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.677649 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.677732 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.677956 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.678046 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.678257 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.678353 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.678594 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.678683 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.678902 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.678998 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.679206 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.679301 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.679515 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.679600 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.679818 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.679903 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.680121 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.680214 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.680422 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.680514 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.680730 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.680817 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.681029 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.681112 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.681329 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.681419 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.681632 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.681717 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.681931 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.682015 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.682240 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.682323 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.682561 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.682646 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.682868 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.682954 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.683164 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.683247 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.683480 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.683563 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.683783 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.683867 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.684081 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.684164 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.684376 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.684467 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.685188 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.685324 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.685529 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.685614 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.685831 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.685923 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.686162 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.686247 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.686511 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.686601 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.686852 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.686947 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.687155 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.687239 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.687454 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.687536 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.687772 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.687856 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.688070 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.688154 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.688367 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.688452 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.688662 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.688746 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.688966 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.689050 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.689274 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.689368 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.689560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.689652 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.689864 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.689992 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.690164 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.690247 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.690490 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.690576 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.690794 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.690879 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.691092 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.691191 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.691392 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.691521 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.691690 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.691775 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.691998 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.692092 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.692302 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.692386 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.692600 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.692684 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.692895 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.692992 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.693199 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.693291 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.693499 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.693595 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.693795 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.693891 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.694098 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.694182 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.694393 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.694556 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.694724 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.694810 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.695020 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.695105 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.695314 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.695397 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.695610 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.695696 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.695911 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.695995 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.696212 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.696295 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.696509 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.696601 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.696822 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.696913 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.697124 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.697208 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.697419 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.697516 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.697715 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.697800 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.698015 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.698099 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.698311 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.698395 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.698631 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.698716 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.698933 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.699028 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.699247 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.699337 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.699557 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.699643 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.699852 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.699944 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.700155 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.700276 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.701040 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.701131 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.701340 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.701517 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.701641 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.701823 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.701946 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.702134 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.702250 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.702457 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.702575 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.702763 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.702865 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.703063 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.703161 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.703369 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.703453 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.703668 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.703753 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.703988 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.704120 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.704296 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.704382 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.704600 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.704685 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.704897 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.704990 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.705195 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.705278 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.705521 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.705604 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.705830 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.705915 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.706158 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.706241 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.706497 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.706593 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.706814 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.706900 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.707119 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.707210 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.707423 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.707508 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.707728 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.707819 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.708024 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.708107 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.708326 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.708416 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.708627 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.708712 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.708933 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.709017 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.709229 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.709313 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.709527 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.709625 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.709824 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.709908 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.710134 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.710226 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.710462 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.710549 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.710772 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.710859 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.711085 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.711248 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.711401 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.711485 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.711696 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.711779 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.712002 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.712095 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.712305 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.712396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.712605 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.712688 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.712906 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.713002 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.713208 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.713298 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.713512 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.713597 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.713816 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.713900 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.714116 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.714199 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.714437 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.714524 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.714746 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.714832 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.715045 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.715129 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.715346 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.715435 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.715647 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.715731 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.715977 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.716068 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.716323 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.716452 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.716624 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.716718 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.716920 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.717006 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.717221 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.717313 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.717519 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.717604 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.717822 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.717906 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.718119 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.718277 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.718494 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.718581 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.718870 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.718953 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.719173 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.719270 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.719472 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.719558 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.719776 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.719860 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.720079 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.720176 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.720384 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.720470 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.720688 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.720772 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.720985 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.721072 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.721286 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.721391 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.721696 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.721780 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.722003 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.722088 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.722304 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.722387 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.722627 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.722712 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.722923 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.723010 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.723225 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.723313 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.723528 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.723613 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.723822 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.723906 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.724119 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.724204 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.724415 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.724507 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.724713 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.724842 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.725015 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.725101 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.725320 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.725417 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.725637 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.725729 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.726014 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.726098 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.726313 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.726429 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.726657 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.726741 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.727039 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.727122 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.727346 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.727443 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.727661 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.727759 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.727978 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.728070 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.728297 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.728382 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.728597 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.728761 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.728905 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.728990 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.729207 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.729291 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.729514 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.729599 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.729827 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.729910 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.730131 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.730219 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.730460 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.730549 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.730761 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.730845 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.731066 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.731153 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.731379 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.731499 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.731722 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.731917 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.732036 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.732287 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.732394 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.732694 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.732780 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.733015 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.733100 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.733321 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.733407 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.733638 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.733723 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.733957 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.734041 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.734256 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.734341 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.734577 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.734661 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.734884 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.735017 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.735184 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.735272 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.735482 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.735566 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.735795 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.735885 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.736095 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.736181 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.736399 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.736484 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.736700 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.736791 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.737004 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.737088 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.737303 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.737387 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.737600 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.737697 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.737913 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.737996 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.738209 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.738294 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.738549 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.738653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.738859 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.738951 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.739175 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.739260 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.739491 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.739584 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.739788 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.739918 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.740104 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.740190 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.740408 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.740551 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.740708 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.740794 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.741003 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.741087 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.741302 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.741388 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.741639 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.741730 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.741940 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.742032 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.742259 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.742354 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.742607 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.742692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.742930 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.743025 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.743235 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.743321 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.743564 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.743651 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.743882 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.743974 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.744193 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.744276 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.744495 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.744584 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.744806 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.744898 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.745122 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.745206 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.745420 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.745511 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.745716 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.745809 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.746018 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.746102 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.746315 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.746397 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.746638 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.746733 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.746937 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.747027 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.747762 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.747895 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.748062 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.748296 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.748381 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.748617 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.748701 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.748922 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.749016 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.749238 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.749328 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.749537 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.749621 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.749846 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.749939 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.750147 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.750277 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.750467 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.750555 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.751024 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.751129 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.751323 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.751413 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.751662 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.751745 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.751963 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.752048 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.752283 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.752374 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.752585 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.752685 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.752904 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.752997 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.753216 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.753302 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.753526 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.753616 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.753834 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.753918 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.754143 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.754228 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.754475 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.754561 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.754786 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.754871 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.755090 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.755184 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.755391 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.755484 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.755698 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.755782 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.756004 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.756094 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.756318 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.756514 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.756826 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.756911 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.757137 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.757220 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.757447 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.757540 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.757753 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.757836 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.758062 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.758146 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.758369 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.758548 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.758701 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.758793 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.759009 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.759093 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.759315 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.759400 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.759620 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.759704 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.759945 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.760037 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.760263 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.760394 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.760578 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.760662 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.760897 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.760991 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.761208 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.761299 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.761521 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.761606 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.761833 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.761931 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.762145 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.762231 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.762497 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.762596 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.763369 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.763471 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.763682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.763769 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.764020 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.764137 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.764333 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.764458 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.764648 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.764757 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.764960 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.765052 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.765268 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.765361 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.765574 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.765659 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.765881 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.765976 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.766190 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.766279 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.766526 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.766624 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.766835 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.766931 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.767145 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.767237 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.767470 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.767568 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.767804 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.767902 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.768122 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.768207 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.768433 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.768519 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.768744 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.768838 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.769061 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.769146 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.769414 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.769571 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.769884 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.769977 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.770213 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.770299 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.770578 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.770683 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.770901 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.770986 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.771212 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.771302 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.771521 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.771611 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.771834 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.771920 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.772133 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.772217 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.772434 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.772528 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.772738 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.772830 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.773382 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.773478 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.773545 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.773635 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.773635 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.773783 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.773929 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.774022 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.774232 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.774326 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.774553 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.774640 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.774870 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.774955 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.775173 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.775397 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.775700 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.775825 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.776037 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.776152 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.776347 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.776443 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.776667 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.776760 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.776980 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.777064 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.777286 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.777372 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.777585 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.777668 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.777901 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.777996 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.778201 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.778287 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.779146 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.779263 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.779466 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.779560 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.779773 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.779868 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.780073 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.780166 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.780373 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.780469 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.780679 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.780769 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.780985 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.781069 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.781280 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.781378 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.781582 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.781674 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.781877 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.781961 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.782196 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.782289 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.782524 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.782626 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.782827 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.782918 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.783125 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.783220 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.783430 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.783515 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.783728 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.783812 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.784027 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.784112 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.784323 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.784407 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.784621 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.784707 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.784920 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.785004 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.785215 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.785298 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.785518 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.785602 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.785816 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.785947 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.786122 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.786208 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.786479 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.786565 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.786784 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.786877 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.787082 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.787174 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.787390 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.787482 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.787686 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.787776 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.787984 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.788070 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.788290 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.788454 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.788591 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.788682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.788906 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.788997 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.789210 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.789304 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.789511 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.789602 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.789849 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.789934 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.790160 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.790375 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.790721 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.790808 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.791038 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.791122 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.791354 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.791440 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.791679 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.791763 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.791983 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.792074 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.792285 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.792380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.792582 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.792666 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.792882 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.792966 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.793194 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.793286 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.793498 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.793584 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.793803 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.793902 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.794666 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.794811 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.794978 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.795069 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.795285 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.795381 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.795593 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.795680 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.795900 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.796027 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.796206 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.796302 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.796512 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.796597 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.796817 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.796903 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.797121 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.797218 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.797425 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.797512 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.797727 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.797810 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.798032 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.798119 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.798343 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.798455 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.798695 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.798787 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.799007 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.799092 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.799318 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.799402 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.799626 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.799708 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.799932 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.800017 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.800233 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.800318 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.800537 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.800630 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.800839 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.800923 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.801140 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.801225 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.801450 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.801545 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.801761 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.801851 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.802065 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.802151 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.802364 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.802940 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.803257 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.803379 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.803585 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.803699 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.803905 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.804017 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.804216 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.804326 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.804537 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.804631 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.804860 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.804947 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.805171 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.805256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.805491 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.805585 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.805801 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.805893 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.806127 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.806213 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.806490 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.806619 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.806815 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.806900 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.807134 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.807225 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.807434 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.807527 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.807736 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.807820 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.808033 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.808118 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.808339 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.808424 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.808657 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.808743 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.808969 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.809062 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.809267 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.809358 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.809580 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.809723 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.809897 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.809984 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.810198 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.810357 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.810526 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.810673 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.810832 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.810979 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.811134 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.811279 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.811444 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.811587 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.811747 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.811886 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.812050 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.812191 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.812351 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.812489 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.812652 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.812788 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.812952 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.813086 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.813252 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.813384 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.813562 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.813686 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.813862 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.813983 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.814165 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.814285 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.814490 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.814615 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.814794 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.814916 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.815095 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.815242 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.815424 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.815512 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.815751 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.815837 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.816063 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.816156 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.816381 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.816467 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.816698 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.816796 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.817008 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.817113 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.817317 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.817403 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.817629 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.817721 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.817943 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.818103 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.818254 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.818340 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.818588 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.818676 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.818920 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.819019 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.819229 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.819314 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.819537 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.819621 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.819843 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.819928 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.820150 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.820236 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.820455 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.820541 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.820762 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.820848 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.821082 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.821166 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.821402 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.821494 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.821703 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.821789 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.822025 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.822112 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.822337 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.822454 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.822760 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.822854 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.823012 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.823125 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.823328 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.823485 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.823655 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.823812 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.823954 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.824152 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.824258 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.824462 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.824567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.824768 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.824875 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.825076 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.825182 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.825436 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.825726 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.825954 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.826034 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.826180 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.826337 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.826512 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.826682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.826828 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.826997 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.827139 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.827324 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.827463 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.827647 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.827786 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.827956 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.828093 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.828279 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.828415 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.828605 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.828738 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.829195 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.829302 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.829383 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.829460 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.829595 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.829705 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.829919 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.830013 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.830230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.830315 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.830572 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.830673 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.830878 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.830972 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:43:13.831119 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:43:13.831206 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:43:13.985323 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO dbcounter [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Registered counter for database nova_api Oct 04 08:43:13.985508 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO dbcounter [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Registered counter for database nova_api Oct 04 08:43:14.007323 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_db.sqlalchemy.engines [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:14.009886 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_db.sqlalchemy.engines [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:14.015131 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writer thread running {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:14.017329 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writer thread running {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:14.071107 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.context [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1cf7a9b-8077-4fd8-a759-81fb5750f051(cell1) {{(pid=112503) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:43:14.073212 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.context [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1cf7a9b-8077-4fd8-a759-81fb5750f051(cell1) {{(pid=112504) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:43:14.075000 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_concurrency.lockutils [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:14.076116 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_concurrency.lockutils [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:14.077663 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_concurrency.lockutils [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:14.077825 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:14.078299 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:14.078391 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_concurrency.lockutils [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:14.078844 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_concurrency.lockutils [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:14.079880 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:14.080603 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:43:14.080815 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_concurrency.lockutils [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:14.081047 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:43:14.082798 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO dbcounter [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Registered counter for database nova_cell0 Oct 04 08:43:14.083048 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:43:14.085018 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO dbcounter [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Registered counter for database nova_cell0 Oct 04 08:43:14.086777 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO dbcounter [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Registered counter for database nova_cell1 Oct 04 08:43:14.089285 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO dbcounter [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Registered counter for database nova_cell1 Oct 04 08:43:14.095311 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_db.sqlalchemy.engines [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:14.096109 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_db.sqlalchemy.engines [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:14.097627 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_db.sqlalchemy.engines [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:14.100054 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_db.sqlalchemy.engines [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:14.103068 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writer thread running {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:14.104512 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writer thread running {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:14.104631 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writer thread running {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:14.243534 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writer thread running {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:14.254550 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO dbcounter [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Registered counter for database nova_cell0 Oct 04 08:43:14.256809 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO dbcounter [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Registered counter for database nova_cell0 Oct 04 08:43:14.261405 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_db.sqlalchemy.engines [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:14.265543 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG oslo_db.sqlalchemy.engines [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:43:14.266279 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writer thread running {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:14.272126 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writer thread running {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:43:14.702857 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: WARNING keystonemiddleware.auth_token [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:43:14.710080 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: WARNING keystonemiddleware.auth_token [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:43:14.720156 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: WARNING keystonemiddleware.auth_token [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:43:14.727669 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: WARNING keystonemiddleware.auth_token [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:43:15.063692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: WARNING keystonemiddleware.auth_token [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:43:15.069759 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: WARNING keystonemiddleware.auth_token [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:43:15.070881 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: WARNING keystonemiddleware.auth_token [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:43:15.075261 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a4d6cb9c0 pid: 112504 (default app) Oct 04 08:43:15.076930 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: WARNING keystonemiddleware.auth_token [None req-95d438dc-48e6-4cf0-af40-6df933c2a22d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:43:15.077333 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:43:15.078526 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001718 Oct 04 08:43:15.078933 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Tue Oct 4 08:43:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:43:15.082143 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a4d6cb9c0 pid: 112503 (default app) Oct 04 08:44:40.670172 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:40.671293 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Oct 04 08:44:40.677381 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:44:40 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:40.690098 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writing DB stats nova_api:SELECT=3 {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:40.691890 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writing DB stats nova_cell0:SELECT=3 {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:40.692768 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writing DB stats nova_cell1:SELECT=3 {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:40.693913 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:41.573521 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-d61fe9fb-675d-43aa-916a-9513d3002609 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:41.673832 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-d61fe9fb-675d-43aa-916a-9513d3002609 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.994310 Oct 04 08:44:41.674484 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 4 08:44:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:44:44.286340 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:44.287375 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-62acea25-4334-40af-8bff-bc59ba2e9c65 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 04 08:44:44.287935 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:44.749260 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-1b78364d-5a4d-4fb4-826f-24c0ec2fd917 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:44.872553 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-1b78364d-5a4d-4fb4-826f-24c0ec2fd917 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.577745 Oct 04 08:44:44.873122 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:44.888414 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_api:SELECT=3 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:44.889463 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_cell0:SELECT=3 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:44.891419 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_cell1:SELECT=3 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:44.892190 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:45.099971 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-dd5befc0-d4ac-4d2f-b684-539dec30d53d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:45.237038 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-dd5befc0-d4ac-4d2f-b684-539dec30d53d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.355063 Oct 04 08:44:45.237640 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:44:47.861551 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-1b78364d-5a4d-4fb4-826f-24c0ec2fd917 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:47.864255 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-1b78364d-5a4d-4fb4-826f-24c0ec2fd917 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003234 Oct 04 08:44:47.864670 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:44:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:48.524859 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-cea5c88d-5ccb-4309-b20a-9c580c1f7973 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:48.675121 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-cea5c88d-5ccb-4309-b20a-9c580c1f7973 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.801003 Oct 04 08:44:48.675758 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:48.687802 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-4f610473-96d8-4447-b31a-450718f123f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:48.805535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-4f610473-96d8-4447-b31a-450718f123f6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121285 Oct 04 08:44:48.806557 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:44:51.425311 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-cea5c88d-5ccb-4309-b20a-9c580c1f7973 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:51.426334 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-cea5c88d-5ccb-4309-b20a-9c580c1f7973 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 04 08:44:51.426775 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:51.891994 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-f2f9dc39-a85d-4578-ae9d-c269c9efc381 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:51.971466 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-f2f9dc39-a85d-4578-ae9d-c269c9efc381 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.537939 Oct 04 08:44:51.972017 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:44:51.984704 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-6d817173-5158-4d9f-94ce-7be1ca0d15c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:52.097065 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-6d817173-5158-4d9f-94ce-7be1ca0d15c2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115961 Oct 04 08:44:52.097621 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:44:54.730394 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-f2f9dc39-a85d-4578-ae9d-c269c9efc381 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:54.731341 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-f2f9dc39-a85d-4578-ae9d-c269c9efc381 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Oct 04 08:44:54.731734 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:55.149883 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-efe137e2-330f-44f1-a6ff-63790b7078c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "disk": 10, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:55.243371 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-efe137e2-330f-44f1-a6ff-63790b7078c0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505260 Oct 04 08:44:55.244682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:55.259290 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-a1c6bb82-0808-48df-bc0e-4675ab3fc4f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:55.341301 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-a1c6bb82-0808-48df-bc0e-4675ab3fc4f2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085872 Oct 04 08:44:55.342289 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:44:58.058696 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-efe137e2-330f-44f1-a6ff-63790b7078c0 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:44:58.059968 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-efe137e2-330f-44f1-a6ff-63790b7078c0 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Oct 04 08:44:58.060489 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:44:58.509589 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-65d60d4e-221d-4247-bafd-6a10ab88d622 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:58.633247 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-65d60d4e-221d-4247-bafd-6a10ab88d622 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.565238 Oct 04 08:44:58.633781 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:44:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:58.647139 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-e6d56fe3-fbd0-41b1-9fb4-7275e1b60bcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:44:58.740982 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-e6d56fe3-fbd0-41b1-9fb4-7275e1b60bcf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097738 Oct 04 08:44:58.741568 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Oct 4 08:44:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:01.927931 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-65d60d4e-221d-4247-bafd-6a10ab88d622 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:01.928942 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-65d60d4e-221d-4247-bafd-6a10ab88d622 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 04 08:45:01.929346 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:02.404086 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-12cc6e4a-ec83-4f74-984a-99ceb930e944 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:02.429424 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-12cc6e4a-ec83-4f74-984a-99ceb930e944 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.492363 Oct 04 08:45:02.429979 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 4 08:45:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:05.113838 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-65d60d4e-221d-4247-bafd-6a10ab88d622 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:05.114873 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-65d60d4e-221d-4247-bafd-6a10ab88d622 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 04 08:45:05.115278 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:05.524610 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-ff3b1f33-3eb7-476c-8195-512c005945d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:05.597747 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-ff3b1f33-3eb7-476c-8195-512c005945d7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.476046 Oct 04 08:45:05.598298 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:45:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:05.611851 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-9e037df8-95c9-480b-b481-9715f627807e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:05.706348 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-9e037df8-95c9-480b-b481-9715f627807e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098391 Oct 04 08:45:05.706963 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 4 08:45:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:08.339963 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-ff3b1f33-3eb7-476c-8195-512c005945d7 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:08.340963 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-ff3b1f33-3eb7-476c-8195-512c005945d7 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 04 08:45:08.341354 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:08.736250 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-279ce781-eb99-4456-8d37-61a7bb4897ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:08.817418 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-279ce781-eb99-4456-8d37-61a7bb4897ad admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470056 Oct 04 08:45:08.818128 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:45:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:08.831050 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-b255b415-18f2-46b7-b9fa-a7e6730a212f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:08.912266 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-b255b415-18f2-46b7-b9fa-a7e6730a212f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084879 Oct 04 08:45:08.912997 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 4 08:45:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:45:11.594434 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-279ce781-eb99-4456-8d37-61a7bb4897ad admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:11.595501 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-279ce781-eb99-4456-8d37-61a7bb4897ad admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 04 08:45:11.595899 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:12.171173 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-806d9c26-e73e-4689-9931-182948eb7d0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:12.281054 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-806d9c26-e73e-4689-9931-182948eb7d0c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.678957 Oct 04 08:45:12.281928 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:45:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:45:12.294866 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-8e9d213a-3941-44d5-b697-e0810c9b4925 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:12.299934 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:12.363726 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-8e9d213a-3941-44d5-b697-e0810c9b4925 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073768 Oct 04 08:45:12.366448 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 4 08:45:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:15.028273 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-806d9c26-e73e-4689-9931-182948eb7d0c admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:15.029195 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-806d9c26-e73e-4689-9931-182948eb7d0c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 04 08:45:15.040947 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:45:15 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:15.564138 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-3910db02-04bd-429e-ab19-a11948b8aa0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "id": "4", "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:16.085851 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-3910db02-04bd-429e-ab19-a11948b8aa0b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.049121 Oct 04 08:45:16.086661 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:45:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:16.103054 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-96d50526-fca5-4f49-a7c2-a3ab1daa27d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:16.108701 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.215974 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-96d50526-fca5-4f49-a7c2-a3ab1daa27d8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116652 Oct 04 08:45:16.216544 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 4 08:45:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:45:18.887702 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-3910db02-04bd-429e-ab19-a11948b8aa0b admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:18.888714 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-3910db02-04bd-429e-ab19-a11948b8aa0b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 04 08:45:18.889190 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:45:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:19.335326 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-160df0b1-68a0-4828-a151-fb543526a18e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "id": "5", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:19.440175 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-160df0b1-68a0-4828-a151-fb543526a18e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.544483 Oct 04 08:45:19.440857 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Oct 4 08:45:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:19.454441 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-a7797685-e97e-4f5d-a1ef-5fccb20fdde0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:19.546740 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-a7797685-e97e-4f5d-a1ef-5fccb20fdde0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097253 Oct 04 08:45:19.548437 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Oct 4 08:45:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:45:36.496868 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-160df0b1-68a0-4828-a151-fb543526a18e admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:36.497874 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-160df0b1-68a0-4828-a151-fb543526a18e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 04 08:45:36.498274 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:45:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:36.509012 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:36.885452 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-d7a28cf4-3108-4634-9899-4fb587c5040d admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:36.903509 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-d7a28cf4-3108-4634-9899-4fb587c5040d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398928 Oct 04 08:45:36.904050 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 4 08:45:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:45:38.221144 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-160df0b1-68a0-4828-a151-fb543526a18e admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.222142 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-160df0b1-68a0-4828-a151-fb543526a18e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 04 08:45:38.226035 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:38.750356 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-5b8cab43-0be7-443a-908f-91b742284aca admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.755998 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.wsgi [None req-5b8cab43-0be7-443a-908f-91b742284aca admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-5b8cab43-0be7-443a-908f-91b742284aca admin admin] Request method failure captured: Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Accept: application/json Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Accept-Encoding: gzip, deflate Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Connection: keep-alive Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Content-Length: 0 Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Host: 10.222.0.27 Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Openstack-System-Scope: None Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: User-Agent: python-novaclient Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Auth-Token: gAAAAABjO_KyPHycafWeDaCN2NxCDoN9Bp1AnYzz4rPsuJ2sSowTtLvPMaWIGKNTXt1gDZgznWyc-_d8MMsdwuQ5V4VPHJ1UqZsYmWcN3r9KWbphPWVkcPDcPkz0NPpnYaCUBES1VpLkaaLsHsSvCspnMLNag0YYCvClaiekz17Qv-_pFAxj0vU Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Domain-Id: None Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Domain-Name: None Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Identity-Status: Confirmed Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Is-Admin-Project: True Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Domain-Id: default Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Domain-Name: Default Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Name: admin Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Role: reader,admin,member Oct 04 08:45:38.759256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Roles: reader,admin,member Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24e9902302e04e8e8d4caf3bfee360d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant: admin Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant-Name: admin Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User: admin Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Domain-Id: default Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Domain-Name: Default Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Id: e79e89b7261f4751ae9cd79132ff7ae2 Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Name: admin Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: method: > Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: exception: Flavor 42 could not be found. Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: action_args: {'id': '42'} Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:38.761535 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.762396 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.763547 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-5b8cab43-0be7-443a-908f-91b742284aca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:38.764641 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-5b8cab43-0be7-443a-908f-91b742284aca admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393535 Oct 04 08:45:38.764641 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 4 08:45:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:38.771131 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-138ba1e9-a4e7-4018-97b1-8920bb85ac65 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.775188 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:38.794231 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-138ba1e9-a4e7-4018-97b1-8920bb85ac65 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026521 Oct 04 08:45:38.794847 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:38.805760 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-caa5d1b2-4027-49ce-b42d-615e72c13ff5 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.828805 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-caa5d1b2-4027-49ce-b42d-615e72c13ff5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027624 Oct 04 08:45:38.829336 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:38.839030 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-29c4af03-f39f-42be-93b2-4e377d0f27f4 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:38.844396 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.wsgi [None req-29c4af03-f39f-42be-93b2-4e377d0f27f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-29c4af03-f39f-42be-93b2-4e377d0f27f4 admin admin] Request method failure captured: Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Accept: application/json Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Accept-Encoding: gzip, deflate Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Connection: keep-alive Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Content-Length: 0 Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Host: 10.222.0.27 Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Openstack-System-Scope: None Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: User-Agent: python-novaclient Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Auth-Token: gAAAAABjO_KyPHycafWeDaCN2NxCDoN9Bp1AnYzz4rPsuJ2sSowTtLvPMaWIGKNTXt1gDZgznWyc-_d8MMsdwuQ5V4VPHJ1UqZsYmWcN3r9KWbphPWVkcPDcPkz0NPpnYaCUBES1VpLkaaLsHsSvCspnMLNag0YYCvClaiekz17Qv-_pFAxj0vU Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Domain-Id: None Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Domain-Name: None Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Identity-Status: Confirmed Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Is-Admin-Project: True Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Domain-Id: default Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Domain-Name: Default Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Name: admin Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Role: reader,admin,member Oct 04 08:45:38.847682 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Roles: reader,admin,member Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24e9902302e04e8e8d4caf3bfee360d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant: admin Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant-Name: admin Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User: admin Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Domain-Id: default Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Domain-Name: Default Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Id: e79e89b7261f4751ae9cd79132ff7ae2 Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Name: admin Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: method: > Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: exception: Flavor 42 could not be found. Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: action_args: {'id': '42'} Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:38.856284 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.857304 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:38.858598 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-29c4af03-f39f-42be-93b2-4e377d0f27f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:38.859872 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-29c4af03-f39f-42be-93b2-4e377d0f27f4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014000 Oct 04 08:45:38.859872 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 4 08:45:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:40.066126 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-caa5d1b2-4027-49ce-b42d-615e72c13ff5 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:40.067167 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-caa5d1b2-4027-49ce-b42d-615e72c13ff5 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 04 08:45:40.067564 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:40.591476 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-72e50d75-2e3d-423d-8a54-e7906bcbf2e7 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:40.596757 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.wsgi [None req-72e50d75-2e3d-423d-8a54-e7906bcbf2e7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-72e50d75-2e3d-423d-8a54-e7906bcbf2e7 admin admin] Request method failure captured: Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Accept: application/json Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Accept-Encoding: gzip, deflate Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Connection: keep-alive Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Content-Length: 0 Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Host: 10.222.0.27 Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Openstack-System-Scope: None Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: User-Agent: python-novaclient Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Auth-Token: gAAAAABjO_KzTwhpKbGIpjj-yH97PfkKL9pXuVz0IQfjIw9k7DeYg6lfQISiDTUglZ9qmXHlMTlxIwWqgNaW5_bm0JT0czGsqsC9oCksmffBUppD7lHnyfw_mfyZxE3dela7apcUsdgeoHreXfzbPBPHdiU_VEvY_dsi8jB13E78rDYSx11OzTY Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Domain-Id: None Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Domain-Name: None Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Identity-Status: Confirmed Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Is-Admin-Project: True Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Domain-Id: default Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Domain-Name: Default Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Name: admin Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Role: reader,admin,member Oct 04 08:45:40.598230 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Roles: reader,admin,member Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24e9902302e04e8e8d4caf3bfee360d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant: admin Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant-Name: admin Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User: admin Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Domain-Id: default Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Domain-Name: Default Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Id: e79e89b7261f4751ae9cd79132ff7ae2 Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Name: admin Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: method: > Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: exception: Flavor 84 could not be found. Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: action_args: {'id': '84'} Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:40.599703 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:40.600567 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.601692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-72e50d75-2e3d-423d-8a54-e7906bcbf2e7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:40.602951 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-72e50d75-2e3d-423d-8a54-e7906bcbf2e7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393943 Oct 04 08:45:40.602951 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 4 08:45:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:40.610265 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-b56ffd90-ace2-4d51-9b4c-070fc7afe18f admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:40.625518 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-b56ffd90-ace2-4d51-9b4c-070fc7afe18f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018876 Oct 04 08:45:40.626040 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:40.635742 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-8bd04c03-ca93-4b55-a3d0-aa87d97df61a admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:40.651147 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-8bd04c03-ca93-4b55-a3d0-aa87d97df61a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019059 Oct 04 08:45:40.651675 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:40.660628 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-4e8e40ec-7a9e-4588-9281-f790dba556fb admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:40.665476 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.wsgi [None req-4e8e40ec-7a9e-4588-9281-f790dba556fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-4e8e40ec-7a9e-4588-9281-f790dba556fb admin admin] Request method failure captured: Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Accept: application/json Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Accept-Encoding: gzip, deflate Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Connection: keep-alive Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Content-Length: 0 Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Host: 10.222.0.27 Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Openstack-System-Scope: None Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: User-Agent: python-novaclient Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Auth-Token: gAAAAABjO_KzTwhpKbGIpjj-yH97PfkKL9pXuVz0IQfjIw9k7DeYg6lfQISiDTUglZ9qmXHlMTlxIwWqgNaW5_bm0JT0czGsqsC9oCksmffBUppD7lHnyfw_mfyZxE3dela7apcUsdgeoHreXfzbPBPHdiU_VEvY_dsi8jB13E78rDYSx11OzTY Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Domain-Id: None Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Domain-Name: None Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Identity-Status: Confirmed Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Is-Admin-Project: True Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Domain-Id: default Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Domain-Name: Default Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Name: admin Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Role: reader,admin,member Oct 04 08:45:40.667560 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Roles: reader,admin,member Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24e9902302e04e8e8d4caf3bfee360d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant: admin Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant-Name: admin Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User: admin Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Domain-Id: default Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Domain-Name: Default Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Id: e79e89b7261f4751ae9cd79132ff7ae2 Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Name: admin Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: method: > Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: exception: Flavor 84 could not be found. Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: action_args: {'id': '84'} Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:40.669055 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:40.669974 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:40.671317 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-4e8e40ec-7a9e-4588-9281-f790dba556fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:40.672541 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-4e8e40ec-7a9e-4588-9281-f790dba556fb admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011700 Oct 04 08:45:40.672541 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Oct 4 08:45:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:41.888948 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-8bd04c03-ca93-4b55-a3d0-aa87d97df61a admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:41.889951 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-8bd04c03-ca93-4b55-a3d0-aa87d97df61a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 04 08:45:41.890374 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:42.434338 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-50fb4612-39c5-4a4e-a94d-69f6978e4f26 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:42.440370 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.wsgi [None req-50fb4612-39c5-4a4e-a94d-69f6978e4f26 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-50fb4612-39c5-4a4e-a94d-69f6978e4f26 admin admin] Request method failure captured: Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Accept: application/json Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Accept-Encoding: gzip, deflate Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Connection: keep-alive Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Content-Length: 0 Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Host: 10.222.0.27 Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Openstack-System-Scope: None Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: User-Agent: python-novaclient Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Auth-Token: gAAAAABjO_K1iBFgOTxTXmf67EcaUy0Ve4uGUPuO7DNojq4KL3gRbKcM1HePZQFxc0qtP1I3GHmINHD27nqMN0wDnRAC0dE0w7Tbe57Ipss5xTUI04BNd9LMYaI58ShKPcRYEcu9Cirex0hbtlOQgLxOiREG7wzPfB2SDbA7LlLqenW-P6TmTFw Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Domain-Id: None Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Domain-Name: None Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Identity-Status: Confirmed Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Is-Admin-Project: True Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Domain-Id: default Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Domain-Name: Default Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Project-Name: admin Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Role: reader,admin,member Oct 04 08:45:42.441883 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Roles: reader,admin,member Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24e9902302e04e8e8d4caf3bfee360d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant: admin Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-Tenant-Name: admin Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User: admin Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Domain-Id: default Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Domain-Name: Default Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Id: e79e89b7261f4751ae9cd79132ff7ae2 Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: X-User-Name: admin Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: method: > Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: exception: Flavor 451 could not be found. Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: action_args: {'id': '451'} Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:42.443386 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:42.444380 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.445689 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-50fb4612-39c5-4a4e-a94d-69f6978e4f26 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:42.446888 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-50fb4612-39c5-4a4e-a94d-69f6978e4f26 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.413253 Oct 04 08:45:42.446888 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 4 08:45:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:42.453672 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-fcaafdb1-ae13-4bb9-b30b-8836051abcbe admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:42.468584 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-fcaafdb1-ae13-4bb9-b30b-8836051abcbe admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018559 Oct 04 08:45:42.469107 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:42.478371 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:42.496693 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021782 Oct 04 08:45:42.497247 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Oct 4 08:45:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:45:42.509505 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-b8350f30-a45b-4a68-bf15-80be3d2ebbb7 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:42.515578 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.wsgi [None req-b8350f30-a45b-4a68-bf15-80be3d2ebbb7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-b8350f30-a45b-4a68-bf15-80be3d2ebbb7 admin admin] Request method failure captured: Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Accept: application/json Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Accept-Encoding: gzip, deflate Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Connection: keep-alive Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Content-Length: 0 Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Host: 10.222.0.27 Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Openstack-Api-Version: compute 2.92 Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Openstack-System-Scope: None Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: User-Agent: python-novaclient Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Auth-Token: gAAAAABjO_K1iBFgOTxTXmf67EcaUy0Ve4uGUPuO7DNojq4KL3gRbKcM1HePZQFxc0qtP1I3GHmINHD27nqMN0wDnRAC0dE0w7Tbe57Ipss5xTUI04BNd9LMYaI58ShKPcRYEcu9Cirex0hbtlOQgLxOiREG7wzPfB2SDbA7LlLqenW-P6TmTFw Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Domain-Id: None Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Domain-Name: None Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Identity-Status: Confirmed Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Is-Admin-Project: True Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Domain-Id: default Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Domain-Name: Default Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Project-Name: admin Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Role: reader,admin,member Oct 04 08:45:42.517115 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Roles: reader,admin,member Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24e9902302e04e8e8d4caf3bfee360d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24e9902302e04e8e8d4caf3bfee360d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant: admin Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant-Id: 24e9902302e04e8e8d4caf3bfee360d5 Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-Tenant-Name: admin Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User: admin Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Domain-Id: default Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Domain-Name: Default Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Id: e79e89b7261f4751ae9cd79132ff7ae2 Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: X-User-Name: admin Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: method: > Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: exception: Flavor 451 could not be found. Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: action_args: {'id': '451'} Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:45:42.518653 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:42.519592 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: ERROR nova.api.openstack.wsgi Oct 04 08:45:42.520858 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-b8350f30-a45b-4a68-bf15-80be3d2ebbb7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:45:42.522066 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-b8350f30-a45b-4a68-bf15-80be3d2ebbb7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012616 Oct 04 08:45:42.522066 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 4 08:45:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:43.734966 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:43.736009 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 04 08:45:43.736397 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:44.255558 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-efd76ea5-2032-45e8-8beb-3742aa5dc108 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:44.393780 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-efd76ea5-2032-45e8-8beb-3742aa5dc108 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.519177 Oct 04 08:45:44.394154 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 4 08:45:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:45.608254 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:45.609256 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 04 08:45:45.609650 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:46.138218 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-00f613ce-5f61-4b41-8b82-c9bd1121f24e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:46.210450 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-00f613ce-5f61-4b41-8b82-c9bd1121f24e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.454532 Oct 04 08:45:46.210949 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 4 08:45:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:47.423762 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:47.425223 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 04 08:45:47.425923 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:47.955982 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-ed44fe39-d882-4ad7-acc8-5d6e6785cd51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:48.045501 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-ed44fe39-d882-4ad7-acc8-5d6e6785cd51 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.479746 Oct 04 08:45:48.046055 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 4 08:45:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:45:49.269459 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:49.270492 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 04 08:45:49.270886 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:49.798769 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-5d91300e-92a7-41b2-8a64-8aeb7007a347 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:45:49.867095 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-5d91300e-92a7-41b2-8a64-8aeb7007a347 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.456033 Oct 04 08:45:49.867636 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Oct 4 08:45:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:51.100422 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:51.101420 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 04 08:45:51.101814 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:45:51.623263 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-5bbc4bc9-9eef-45df-9ea4-cbcc915ff60a admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:45:51.643615 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-5bbc4bc9-9eef-45df-9ea4-cbcc915ff60a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406276 Oct 04 08:45:51.644146 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Oct 4 08:45:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:48.570467 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:48.572057 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-78ada44e-f744-416a-a05e-80970e13a4cc admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 Oct 04 08:46:48.572455 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Tue Oct 4 08:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:46:48.583189 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:48.963108 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-1ca35d93-e876-46df-ab90-6529bd8e03d6 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:48.984296 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-1ca35d93-e876-46df-ab90-6529bd8e03d6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405541 Oct 04 08:46:48.984854 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Oct 4 08:46:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:46:49.005871 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG dbcounter [-] [112503] Writing DB stats nova_api:SELECT=14 {{(pid=112503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:49.009564 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-6ad1472a-0784-4c7c-84fc-61df1fb04d5f admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:49.016680 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-6ad1472a-0784-4c7c-84fc-61df1fb04d5f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012224 Oct 04 08:46:49.024327 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Oct 4 08:46:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:49.029084 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-9f16374e-9276-4932-89e7-55f59cb15ec6 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:49.036433 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-9f16374e-9276-4932-89e7-55f59cb15ec6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010912 Oct 04 08:46:49.036939 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Oct 4 08:46:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:46:49.048926 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:49.056601 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011124 Oct 04 08:46:49.057122 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Oct 4 08:46:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:46:49.068560 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-4633e575-b6f1-47bb-8936-b007125c0aa5 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:46:49.075692 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-4633e575-b6f1-47bb-8936-b007125c0aa5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010651 Oct 04 08:46:49.076190 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Oct 4 08:46:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:49:55.143308 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:55.144341 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 04 08:49:55.144733 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:49:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:55.292447 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_api:SELECT=6 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:55.450568 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-c40cd6cc-6fde-4e37-9b10-4573ae30e927 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:55.455287 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-c40cd6cc-6fde-4e37-9b10-4573ae30e927 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:55.455748 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-c40cd6cc-6fde-4e37-9b10-4573ae30e927 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:55.456171 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-c40cd6cc-6fde-4e37-9b10-4573ae30e927 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:55.456868 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-c40cd6cc-6fde-4e37-9b10-4573ae30e927 admin admin] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:55.457306 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-c40cd6cc-6fde-4e37-9b10-4573ae30e927 admin admin] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:55.457714 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-c40cd6cc-6fde-4e37-9b10-4573ae30e927 admin admin] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:55.488413 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-c40cd6cc-6fde-4e37-9b10-4573ae30e927 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197080 Oct 04 08:49:55.488960 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 4 08:49:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:49:56.629176 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:56.630464 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Oct 04 08:49:56.630868 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:49:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:49:56.830282 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-8ee9b87b-eb6d-417f-8ba1-1d06d6f3c269 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:49:56.834345 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-8ee9b87b-eb6d-417f-8ba1-1d06d6f3c269 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:56.834859 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-8ee9b87b-eb6d-417f-8ba1-1d06d6f3c269 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:56.835291 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-8ee9b87b-eb6d-417f-8ba1-1d06d6f3c269 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:56.836007 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-8ee9b87b-eb6d-417f-8ba1-1d06d6f3c269 admin admin] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:49:56.836934 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-8ee9b87b-eb6d-417f-8ba1-1d06d6f3c269 admin admin] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:49:56.837361 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-8ee9b87b-eb6d-417f-8ba1-1d06d6f3c269 admin admin] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:49:56.857695 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-8ee9b87b-eb6d-417f-8ba1-1d06d6f3c269 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080796 Oct 04 08:49:56.858273 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 4 08:49:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:50:08.378220 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:08.379276 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 04 08:50:08.379933 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:50:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:50:08.524310 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_cell0:SELECT=4 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:08.525035 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_cell1:SELECT=4 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:08.525636 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG dbcounter [-] [112504] Writing DB stats nova_api:SELECT=8 {{(pid=112504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:08.573922 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-2f7f6047-9c85-469e-a70e-213a3a306d20 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:08.577396 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-2f7f6047-9c85-469e-a70e-213a3a306d20 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:08.577868 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-2f7f6047-9c85-469e-a70e-213a3a306d20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:08.578292 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-2f7f6047-9c85-469e-a70e-213a3a306d20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:08.579014 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-2f7f6047-9c85-469e-a70e-213a3a306d20 admin admin] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:08.579455 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-2f7f6047-9c85-469e-a70e-213a3a306d20 admin admin] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:08.579863 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-2f7f6047-9c85-469e-a70e-213a3a306d20 admin admin] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:08.605564 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-2f7f6047-9c85-469e-a70e-213a3a306d20 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085732 Oct 04 08:50:08.606109 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 4 08:50:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:50:09.717222 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: DEBUG nova.api.openstack.wsgi [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] Calling method '>' {{(pid=112503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:09.718227 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: INFO nova.api.openstack.requestlog [None req-b60d8ed0-3c7e-48de-a477-43a2211431e4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Oct 04 08:50:09.718850 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: [pid: 112503|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Oct 4 08:50:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:50:09.920425 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG nova.api.openstack.wsgi [None req-0fa6ef1e-c73c-4440-9768-ce90be3c5211 admin admin] Calling method '>' {{(pid=112504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:50:09.924085 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-0fa6ef1e-c73c-4440-9768-ce90be3c5211 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:09.924506 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-0fa6ef1e-c73c-4440-9768-ce90be3c5211 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:09.924935 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-0fa6ef1e-c73c-4440-9768-ce90be3c5211 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:09.925649 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-0fa6ef1e-c73c-4440-9768-ce90be3c5211 admin admin] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:50:09.926535 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-0fa6ef1e-c73c-4440-9768-ce90be3c5211 admin admin] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:50:09.926535 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: DEBUG oslo_concurrency.lockutils [None req-0fa6ef1e-c73c-4440-9768-ce90be3c5211 admin admin] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:50:09.948915 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: INFO nova.api.openstack.requestlog [None req-0fa6ef1e-c73c-4440-9768-ce90be3c5211 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079943 Oct 04 08:50:09.949478 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: [pid: 112504|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Oct 4 08:50:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:51:08.728193 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: Tue Oct 4 08:51:08 2022 - graceful shutdown triggered... Oct 04 08:51:08.728293 dv-cinder-859447-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 08:51:08.729298 dv-cinder-859447-2-iscsi devstack@n-api.service[112503]: Gracefully killing worker 1 (pid: 112503)... Oct 04 08:51:08.729733 dv-cinder-859447-2-iscsi devstack@n-api.service[112504]: Gracefully killing worker 2 (pid: 112504)... Oct 04 08:51:09.729686 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: worker 1 buried after 1 seconds Oct 04 08:51:09.730125 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: worker 2 buried after 1 seconds Oct 04 08:51:09.730125 dv-cinder-859447-2-iscsi devstack@n-api.service[112502]: goodbye to uWSGI. Oct 04 08:51:09.731234 dv-cinder-859447-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 04 08:51:09.731787 dv-cinder-859447-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 08:51:09.734525 dv-cinder-859447-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 08:51:09.751388 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:51:09 2022] *** Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: nodename: dv-cinder-859447-2-iscsi Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: machine: x86_64 Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: clock source: unix Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: pcre jit disabled Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: detected number of CPU cores: 4 Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: current working directory: / Oct 04 08:51:09.753226 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:51:09.753952 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: your processes number limit is 47680 Oct 04 08:51:09.753952 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: your memory page size is 4096 bytes Oct 04 08:51:09.753952 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: detected max file descriptor number: 2048 Oct 04 08:51:09.753952 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: lock engine: pthread robust mutexes Oct 04 08:51:09.753952 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: thunder lock: enabled Oct 04 08:51:09.753952 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 08:51:09.753952 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:51:09.794876 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: Python main interpreter initialized at 0x561799bc59c0 Oct 04 08:51:09.794876 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: python threads support enabled Oct 04 08:51:09.794876 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: your server socket listen backlog is limited to 100 connections Oct 04 08:51:09.794876 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:51:09.795340 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:51:09.795340 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: *** Operational MODE: preforking *** Oct 04 08:51:09.795573 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:51:09.795573 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: spawned uWSGI master process (pid: 127532) Oct 04 08:51:09.795803 dv-cinder-859447-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 08:51:09.796396 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: spawned uWSGI worker 1 (pid: 127548, cores: 1) Oct 04 08:51:09.796760 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: spawned uWSGI worker 2 (pid: 127549, cores: 1) Oct 04 08:51:09.796871 dv-cinder-859447-2-iscsi devstack@n-api.service[127532]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:51:10.460184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:51:10.485575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 08:51:11.622599 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:51:11.622599 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: from cryptography.utils import int_from_bytes Oct 04 08:51:11.623585 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:51:11.623585 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: from cryptography.utils import int_from_bytes Oct 04 08:51:11.658369 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:51:11.658369 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: from cryptography.utils import int_from_bytes Oct 04 08:51:11.658961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:51:11.658961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: from cryptography.utils import int_from_bytes Oct 04 08:51:14.131084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:51:14.131743 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:51:14.132148 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:51:14.132358 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:51:14.132571 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:51:14.132966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.133301 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.141262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.141262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.141262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.141262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.141262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.141262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.141262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.141262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859447-2-iscsi {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.142894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.143327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.143327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.143327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.143327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.143327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.143630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:51:14.144043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.144128 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:51:14.144204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859447-2-iscsi {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.144273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:51:14.144350 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.144435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:51:14.144516 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.144593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:51:14.144662 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.144738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.144813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.144895 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.144972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.145480 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.145674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.145838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.145987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.146219 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.146370 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.146370 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.146729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.146729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.147055 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.147308 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.147308 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.147756 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.148035 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.148035 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.148458 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.148458 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.148778 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859447-2-iscsi {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.149007 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.149647 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.149892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.150069 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.150305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.150651 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.150987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.151224 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.151540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.151699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.151872 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.152069 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.152224 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.152425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.152582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.152810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.153068 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.153394 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.153723 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.153988 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.154156 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.154339 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.154525 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.154676 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.154817 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.154966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.155280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.155433 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.155602 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.155744 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.155919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.156101 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.156252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.156404 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.156552 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.156700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.156850 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.156998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.157420 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.157729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.157890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.158042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.158260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.158492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.158653 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.158849 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.159006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.159155 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.159327 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859447-2-iscsi {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.159866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.160022 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.160170 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.160342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.161390 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.161557 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.161720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.161720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.162011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.162167 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.162309 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.162477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.162633 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.163342 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.163565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.163725 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.163877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.164029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.164177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.164324 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.164467 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.164628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.164770 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.164919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.165060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.165060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.165343 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.165494 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.165646 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.165787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.165941 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.166091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.166248 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.166452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.166604 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.166745 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.175447 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.175697 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.175861 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.176013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.176155 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.176295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.176442 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.176590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.176740 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.176881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.177046 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.177194 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.177370 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.177585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.177585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.178043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.178201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.179165 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.179540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.180352 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.180596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.180811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.181047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.181325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.181946 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.182121 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.182279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.182453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.182453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.182453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.183098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.183251 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.183251 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.183522 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.183689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.183840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.183990 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.184131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.184344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.184344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.184816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.185002 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.185191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.185428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.185638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.185794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.185999 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.186159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.186301 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.186502 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.186658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.186813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.186961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.187101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.187249 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.187389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.187539 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.187695 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.187845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.187986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.188397 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.188646 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.188863 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.188863 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.192489 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.192695 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.192879 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.193131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.193312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.193472 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.193724 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.193724 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.194191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.194191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.194786 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.195074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.195320 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.195551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.195551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.195840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.195994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.196186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.196421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.196663 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.196909 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.197075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.197075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.197368 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.197587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.197898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.198152 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.198761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.198937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.199084 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.199084 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.199367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.199520 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.199672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.199826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.199826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.200306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.200479 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.200625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.200776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.200776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.201043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.201236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.201398 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.201554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.201703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.201703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.201703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.203494 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.203642 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.203642 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.203949 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.204192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.204428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.204658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.204903 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.205162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.205407 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.205644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.205644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.206107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.206332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.206660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.206660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.207116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.207286 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.207431 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.207573 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.207713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.207713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.207713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.208117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.208325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.208485 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.208485 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.208986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.209147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.209290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.209290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.209290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.209833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.210042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.210293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.210598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.210785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.210942 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.211099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.211242 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.211398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.211541 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.211690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.211843 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.211985 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.212392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.213259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.213411 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.213532 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.213649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.213770 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.213770 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.213985 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.214107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.214217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.214325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.214325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.221303 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.221463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.221463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.222009 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.222160 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.222540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.222540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.223296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.223296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.223678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.223821 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:51:14.223821 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.224109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.224261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.224410 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.224552 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.224700 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.224853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.225013 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.225170 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.225849 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.226000 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.226000 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.226278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.226278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.226610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.226753 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.226894 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.226894 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.227167 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.227167 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.227463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.227613 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.227762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.227910 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.227910 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.228191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.228340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.228340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.228340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.228762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.228762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.229162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.229162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.229162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.229162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.229162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.229162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.229162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.229162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.230249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.230249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.230249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.230249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.230249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.230249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.230249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.230249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.231582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.231794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.231944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.231944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.232233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.232804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.233810 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.233981 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.234136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.234288 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.234486 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.234649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.234878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.235031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.235265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.235490 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.235644 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.235787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.235948 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.236092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.236233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.236381 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.236524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.236684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.236842 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.236985 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.236985 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.237260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.237400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.237540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.237695 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.237838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.237978 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.238127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.238276 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.238635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.238858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.239007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.239225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.239583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.239825 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.240091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.240330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.240540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.240688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.240880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.241657 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.241824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.241973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242375 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.242683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.243643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.243746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.243746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.243746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244264 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244264 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244600 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244669 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244669 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244882 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.244950 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245037 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245717 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.245937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246076 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246161 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246161 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246301 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246556 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246556 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.246937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247005 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247338 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247407 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.247925 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248002 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248289 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248413 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248552 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248552 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248815 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.248942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249470 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249636 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249782 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249859 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.249929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.250827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.256125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.256329 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.256573 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.256794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.257144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.257346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.257653 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.257844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.258005 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.258156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.258312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.258505 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.258672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.258834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.258996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.259228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.259550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.259550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.259947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.260124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.260402 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.260607 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.260795 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.260954 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.261104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.261267 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.261424 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.261584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.261736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.261996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.262248 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.262560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.262560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.263071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.263440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.263616 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.264782 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.265060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.265060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.265467 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.265630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.265779 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.265779 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.266077 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.266225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.266225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.266601 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.266761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.266761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.267075 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.267307 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.267307 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.267896 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.268070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.268220 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.268377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.268534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.268682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.268842 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.269023 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.269277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.269614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.269881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.269881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.270388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.270775 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.270938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271668 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.271838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.273377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.273746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.273923 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.274784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.275415 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.275645 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.275645 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.275974 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.276125 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.276281 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.276437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.276599 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.276803 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.276959 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.277107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.277262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.277410 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.277567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.277717 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.277883 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.278039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.278195 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.278357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.278584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.278757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.279003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.279194 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.279352 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.279521 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.279722 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.279877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280996 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.280996 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.281215 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.281333 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.281333 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.281543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.281708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.281839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.281962 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.282071 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.282188 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.282309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.282451 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.284799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.284966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.284966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.285662 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.285828 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.285986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.286209 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.286359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.286548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.286709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.286869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.287025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.287174 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.287329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.287486 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.287642 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.288380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.288573 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.288733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.288894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.289043 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.289205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.289379 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.289537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.289687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.289887 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.290051 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.290209 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.290367 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.290577 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.290727 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.290989 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.291173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.291337 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.291492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.291652 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.291808 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.291956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.292114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.292270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.292427 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.292427 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.292716 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.292865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.292865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.293186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.293350 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.293350 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.293975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.294134 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.294134 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.294560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.294961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.295118 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.295275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.295275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.295275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.295929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.296111 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.296387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.296558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.296725 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.296883 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.297032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.297181 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.297181 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.297469 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.297631 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.297791 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.297980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.298144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.298301 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.298620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.298889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.299060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.299211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.299367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.299524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.299682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.299878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.300030 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.300179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.300326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.300326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.300673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.300826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.301000 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.301235 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.301391 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.301557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.301717 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.301875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.302039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.302195 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.302344 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.302519 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.302698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.302856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.302856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.303146 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.303295 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.304222 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.304432 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.304680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.306219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.306382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.306583 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.306749 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.306901 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.307067 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.307217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.307366 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.307522 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.307680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.307836 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.307984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.308152 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.308313 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.308462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.308704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.308865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.308865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.309212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.309369 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.309544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.309544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.309847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.310042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.310193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.310344 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.310344 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.319830 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320630 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.320985 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.321101 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.321190 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.321281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.321716 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.321814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.321896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.321978 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322065 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322137 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322355 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322611 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322762 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322841 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.322933 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323276 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323359 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323762 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.323944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324238 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324449 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324627 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.324971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.325067 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.325186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.325456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.325553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.325644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.325729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.325729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.325888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326001 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326188 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326868 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.326952 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327227 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.327942 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328026 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328121 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328379 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328468 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328559 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328652 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328743 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328833 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.328916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329074 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329360 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329450 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329630 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329722 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329806 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329895 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.329979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330164 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330257 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330348 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330458 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330557 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.330937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331030 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331121 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331309 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331484 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331773 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.331946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332029 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332111 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332298 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332389 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332471 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332550 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.332972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333136 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333230 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333230 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333652 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333748 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.333921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.334063 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.334304 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.334395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.334561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.335595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.335742 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.335877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336013 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336653 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336739 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.336936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337198 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337562 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337646 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337728 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.337915 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338006 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338339 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338655 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.338997 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339427 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339593 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339772 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339855 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.339951 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340036 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.340955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341119 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341282 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341373 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341637 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341772 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.341907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.342109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.342205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.342523 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.342710 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.342818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.343037 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.343190 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.343342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.343491 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.343638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.343782 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.343932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.344079 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.344233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.344375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.344523 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.344699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.344853 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.345137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.345294 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.345473 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.345791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.345944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.346046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.346128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.346200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.346428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.346902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.347230 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.347474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.347578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.347881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.348049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.348201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.348646 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.348753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.348968 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.349207 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.349303 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.349599 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.349783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.349917 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.350422 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.350597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.350821 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.351070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.351167 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.351466 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.351753 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.351859 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.352091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.352213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.352427 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.352533 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.352742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.352844 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.353074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.353182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.353496 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.353595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.353827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.353941 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.354137 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.354241 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.354524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.354863 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.355183 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.355501 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.355957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.356340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.356489 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.356809 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.357278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.357521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.357860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.358186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.358554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.358705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.358897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.359064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.359227 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.359545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.359640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.359908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.360267 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.360621 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.360953 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.361053 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.361295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.361396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.361616 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.361722 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.361937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.362038 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.362261 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.362355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.362609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.362735 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.362956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.363050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.363271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.363373 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.363591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.363709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.363928 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.364042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.364258 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.364371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.364583 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.364689 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.365022 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.365363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.365691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.366620 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.366964 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.367286 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.367404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.367608 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.370969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371183 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371276 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.371890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.372017 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.372096 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.372176 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.375735 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.375857 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.375936 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.375936 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.376246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.376347 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.376347 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.376492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.376929 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377263 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377333 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377411 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377511 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377589 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377739 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377819 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.377976 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378589 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378755 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.378961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379034 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379241 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379646 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.379995 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380363 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380715 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380814 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.380901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.381059 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.381153 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.381249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.381334 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.381425 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.381620 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382313 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382529 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382600 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382772 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382772 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.382927 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383017 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383111 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383203 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383385 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383494 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383588 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.383920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.384136 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.384237 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.384454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.384544 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.384770 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.384871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.385084 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.385183 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.385400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.385796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.385796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.385961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.386049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.386189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.386363 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.386492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.386710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.386849 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.387119 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.387220 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.387352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.387452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.387679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.387764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.391157 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.411961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.411961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.412738 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.412857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.412955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413052 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413139 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413232 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413599 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413863 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.413943 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414111 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414394 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414526 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414613 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414696 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414893 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.414979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415069 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415154 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415248 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415426 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415512 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415686 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.415979 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416065 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416248 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416344 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416438 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416523 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416876 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.416980 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.417066 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.417151 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.417478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.417570 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.417662 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.417761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.417854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.417947 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418033 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418120 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418216 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418490 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418656 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.418939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419023 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419199 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419461 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419634 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419728 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419812 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.419985 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420163 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420427 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420606 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420775 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420868 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.420948 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421041 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421369 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421538 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421621 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421712 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421904 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.421996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422337 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422626 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422892 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.422977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423067 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423152 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423242 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423333 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423425 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423518 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423602 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423685 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423860 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.423945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424036 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424121 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424394 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424482 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424482 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424896 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.424986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425070 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425152 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425241 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425767 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.425944 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426126 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426209 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426579 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426663 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426663 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426823 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.426921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427013 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427179 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427262 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427369 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427623 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427815 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427912 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.427993 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.428073 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.428153 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.428231 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.428848 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.428994 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429095 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429282 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429366 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429533 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429618 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429618 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429885 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.429977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430432 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430520 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430603 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430704 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430882 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.430966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431214 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431306 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431481 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431571 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431766 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.431991 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432068 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432154 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432226 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432370 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432440 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432529 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432626 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432716 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432795 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.432935 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433184 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433268 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433359 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433449 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433543 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433627 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433717 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.433891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434046 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434130 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434222 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434539 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.434985 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435076 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435258 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435341 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435763 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.435928 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436291 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436384 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436656 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.436839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437016 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437100 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437255 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437408 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437723 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.437934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438027 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438027 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438163 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438522 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438617 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438703 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438793 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.438974 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439156 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439246 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439422 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439600 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439768 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439859 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.439958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440228 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440473 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440564 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440815 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.440907 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441005 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441087 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441416 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441509 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.441755 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442364 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442477 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442571 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442812 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.442998 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443082 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443180 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443282 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443458 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443542 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443632 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443717 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443808 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.443975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.444091 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.444687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.444771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.444861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.444945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445037 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445333 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445416 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445728 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.445834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.446054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.446157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.446377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452113 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452113 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452373 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452537 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452717 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452809 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.452973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453058 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453143 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453241 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453409 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453577 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453661 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453756 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.453922 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454005 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454095 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454188 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454370 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454510 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454608 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454694 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454872 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.454955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:51:14.455039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.455670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.456043 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.456043 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.456338 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.456669 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.456993 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.457310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.457647 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.457967 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.458285 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.458636 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.458952 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.459271 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.459635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.459957 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.460289 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.460590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.460918 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.461256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.461590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.461905 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.462239 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.462600 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.462958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.463279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.463629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.463967 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.464289 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.464609 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.464921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:51:14.465171 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:51:14.515021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO dbcounter [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Registered counter for database nova_api Oct 04 08:51:14.528060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO dbcounter [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Registered counter for database nova_api Oct 04 08:51:14.535742 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:51:14.542745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writer thread running {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:51:14.548791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_db.sqlalchemy.engines [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:51:14.556160 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writer thread running {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:51:14.600411 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.context [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1cf7a9b-8077-4fd8-a759-81fb5750f051(cell1) {{(pid=127549) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:51:14.604578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:14.607124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:14.607124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:14.607450 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:14.607884 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:14.609978 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:14.612009 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO dbcounter [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Registered counter for database nova_cell0 Oct 04 08:51:14.612614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.context [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1cf7a9b-8077-4fd8-a759-81fb5750f051(cell1) {{(pid=127548) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 08:51:14.616706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO dbcounter [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Registered counter for database nova_cell1 Oct 04 08:51:14.617272 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:14.617759 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:14.619370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:14.620122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:51:14.620581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:51:14.622658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:51:14.624750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO dbcounter [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Registered counter for database nova_cell0 Oct 04 08:51:14.624881 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:51:14.626935 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:51:14.628956 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO dbcounter [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Registered counter for database nova_cell1 Oct 04 08:51:14.634073 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writer thread running {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:51:14.636218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writer thread running {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:51:14.637042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_db.sqlalchemy.engines [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:51:14.639699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_db.sqlalchemy.engines [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:51:14.646855 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writer thread running {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:51:14.648201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writer thread running {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:51:14.784896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO dbcounter [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Registered counter for database nova_cell0 Oct 04 08:51:14.792012 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:51:14.796444 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writer thread running {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:51:14.800205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO dbcounter [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Registered counter for database nova_cell0 Oct 04 08:51:14.808437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_db.sqlalchemy.engines [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:51:14.813638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writer thread running {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:51:15.128585 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: WARNING keystonemiddleware.auth_token [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:51:15.137409 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: WARNING keystonemiddleware.auth_token [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:51:15.138658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: WARNING keystonemiddleware.auth_token [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:51:15.145879 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: WARNING keystonemiddleware.auth_token [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:51:15.496802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: WARNING keystonemiddleware.auth_token [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:51:15.498437 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: WARNING keystonemiddleware.auth_token [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 08:51:15.501356 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: WARNING keystonemiddleware.auth_token [None req-2839d6ce-33c1-44b5-b2fe-f23fe57c9ef6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:51:15.504655 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: WARNING keystonemiddleware.auth_token [None req-9fc64ee1-a7a6-4145-93b6-28f0d3fda5a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 08:51:15.507479 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561799bc59c0 pid: 127548 (default app) Oct 04 08:51:15.512159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561799bc59c0 pid: 127549 (default app) Oct 04 08:51:53.528133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:53.528133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:53.528133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:53.529031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:54.921625 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9aa5956f-b43c-446a-8bb3-b9f7c5c51f64 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Action: 'create', calling method: .version_select at 0x7f6f1b4a1550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1433456936", "metadata": {"Type": "work"}}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9aa5956f-b43c-446a-8bb3-b9f7c5c51f64 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Request method failure captured: Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 122 Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_QpUiO6idNQ4jlrx65laF4xRs1_eYe7c__sYNZN4es5t04_v0PE7OskyR1vaEkfstTrorlzM1Fl7A6wBSeM2-WSoY2bcNhyEGArjt0H8WIbLtLYPHA3gb1gfZ2hyqpRHp4S0Gwa0AVyGXT7C-CqKvCSLCrBBy6mFrYlu_7zpDk4Diw Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:51:54.950442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2581751051d45deb15e3461411ec41e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2581751051d45deb15e3461411ec41e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 06065e7f3625480db47ef2f3e53aff85 Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1433456936", "metadata": {"Type": "work"}}} Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: Oct 04 08:51:54.951837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1433456936', 'metadata': {'Type': 'work'}}}} Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:54.952666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:51:54.954030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:51:54.964144 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 08:51:54.964144 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:54.964144 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9aa5956f-b43c-446a-8bb3-b9f7c5c51f64 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:54.964144 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9aa5956f-b43c-446a-8bb3-b9f7c5c51f64 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.452795 Oct 04 08:51:54.964144 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 4 08:51:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1456 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:51:55.513146 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-014349c7-81b0-4efe-9e73-88467bf524c6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Action: 'create', calling method: .version_select at 0x7f6f1b552f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-668377511", "metadata": {"Type": "work"}}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-014349c7-81b0-4efe-9e73-88467bf524c6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Request method failure captured: Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 119 Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_QpUiO6idNQ4jlrx65laF4xRs1_eYe7c__sYNZN4es5t04_v0PE7OskyR1vaEkfstTrorlzM1Fl7A6wBSeM2-WSoY2bcNhyEGArjt0H8WIbLtLYPHA3gb1gfZ2hyqpRHp4S0Gwa0AVyGXT7C-CqKvCSLCrBBy6mFrYlu_7zpDk4Diw Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:51:55.520097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2581751051d45deb15e3461411ec41e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2581751051d45deb15e3461411ec41e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 06065e7f3625480db47ef2f3e53aff85 Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-668377511", "metadata": {"Type": "work"}}} Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: Oct 04 08:51:55.526896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-668377511', 'metadata': {'Type': 'work'}}}} Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi '0' Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:55.529794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:51:55.533547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:51:55.535809 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 08:51:55.535809 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.535809 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-014349c7-81b0-4efe-9e73-88467bf524c6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:55.535809 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-014349c7-81b0-4efe-9e73-88467bf524c6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.551469 Oct 04 08:51:55.535809 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 1/2] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 4 08:51:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 565 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:51:55.544118 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-062ee609-6b4f-4973-a0d3-a799960bcfa2 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Action: 'create', calling method: .version_select at 0x7f6f1b4a1e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-971845994", "metadata": {"Type": "work"}}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-062ee609-6b4f-4973-a0d3-a799960bcfa2 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Request method failure captured: Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 118 Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_QpUiO6idNQ4jlrx65laF4xRs1_eYe7c__sYNZN4es5t04_v0PE7OskyR1vaEkfstTrorlzM1Fl7A6wBSeM2-WSoY2bcNhyEGArjt0H8WIbLtLYPHA3gb1gfZ2hyqpRHp4S0Gwa0AVyGXT7C-CqKvCSLCrBBy6mFrYlu_7zpDk4Diw Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:51:55.562018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2581751051d45deb15e3461411ec41e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2581751051d45deb15e3461411ec41e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 06065e7f3625480db47ef2f3e53aff85 Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-971845994", "metadata": {"Type": "work"}}} Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: Oct 04 08:51:55.563091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-971845994', 'metadata': {'Type': 'work'}}}} Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise error Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi '' Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:55.563640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 08:51:55.564718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 08:51:55.565554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 08:51:55.565554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:55.566801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-062ee609-6b4f-4973-a0d3-a799960bcfa2 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:55.567854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-062ee609-6b4f-4973-a0d3-a799960bcfa2 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028699 Oct 04 08:51:55.574782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 2/3] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 4 08:51:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:51:55.575506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:55.576360 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:55.577061 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:55.577774 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:55.607797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-93bc8a45-98e0-421d-ba33-45c809256208 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Calling method '.version_select at 0x7f6f1b4e09d0>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:56.313589 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-93bc8a45-98e0-421d-ba33-45c809256208 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] HTTP exception thrown: Volume tempest-invalid-1561211958 could not be found. Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-93bc8a45-98e0-421d-ba33-45c809256208 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Request method failure captured: Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1561211958 HTTP/1.1 Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_QpUiO6idNQ4jlrx65laF4xRs1_eYe7c__sYNZN4es5t04_v0PE7OskyR1vaEkfstTrorlzM1Fl7A6wBSeM2-WSoY2bcNhyEGArjt0H8WIbLtLYPHA3gb1gfZ2hyqpRHp4S0Gwa0AVyGXT7C-CqKvCSLCrBBy6mFrYlu_7zpDk4Diw Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:51:56.317568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2581751051d45deb15e3461411ec41e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2581751051d45deb15e3461411ec41e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 06065e7f3625480db47ef2f3e53aff85 Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Volume tempest-invalid-1561211958 could not be found. Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'tempest-invalid-1561211958'} Oct 04 08:51:56.318908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1561211958 could not be found. (HTTP 404) (Request-ID: req-2aa37033-43f6-4ef2-b55e-e8d4659c281b) Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.319759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:56.327487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1561211958 could not be found. Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:56.328972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1561211958 could not be found. Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1561211958 could not be found. Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-93bc8a45-98e0-421d-ba33-45c809256208 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Returning 404 to user: Volume tempest-invalid-1561211958 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-93bc8a45-98e0-421d-ba33-45c809256208 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1561211958" status: 404 len: 99 microversion: 2.1 time: 0.744611 Oct 04 08:51:56.331378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 4 08:51:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1561211958 => generated 99 bytes in 746 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 08:51:56.359677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-93d7b2ea-3834-4d07-850b-ea48a9c86503 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022872 Oct 04 08:51:56.361194 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 4 08:51:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 08:51:56.374164 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c3b1a7d5-df78-4813-8ac5-a7b5a72e2836 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005007 Oct 04 08:51:56.374755 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Oct 4 08:51:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 08:51:56.388886 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c21ff110-e518-4553-98f6-bf91ad3cdfec tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Calling method '.version_select at 0x7f6f1b35f4c0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:56.761094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-c21ff110-e518-4553-98f6-bf91ad3cdfec tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] HTTP exception thrown: Volume ce3b317c-c2a8-494e-b218-8c5ad7462dc0 could not be found. Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c21ff110-e518-4553-98f6-bf91ad3cdfec tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Request method failure captured: Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/os-volumes/ce3b317c-c2a8-494e-b218-8c5ad7462dc0 HTTP/1.1 Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_QpUiO6idNQ4jlrx65laF4xRs1_eYe7c__sYNZN4es5t04_v0PE7OskyR1vaEkfstTrorlzM1Fl7A6wBSeM2-WSoY2bcNhyEGArjt0H8WIbLtLYPHA3gb1gfZ2hyqpRHp4S0Gwa0AVyGXT7C-CqKvCSLCrBBy6mFrYlu_7zpDk4Diw Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:51:56.765844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2581751051d45deb15e3461411ec41e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2581751051d45deb15e3461411ec41e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 06065e7f3625480db47ef2f3e53aff85 Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Volume ce3b317c-c2a8-494e-b218-8c5ad7462dc0 could not be found. Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'ce3b317c-c2a8-494e-b218-8c5ad7462dc0'} Oct 04 08:51:56.767180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce3b317c-c2a8-494e-b218-8c5ad7462dc0 could not be found. (HTTP 404) (Request-ID: req-3ff242d5-7c72-4940-9ed4-4855260ef7de) Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.767906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 08:51:56.768950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce3b317c-c2a8-494e-b218-8c5ad7462dc0 could not be found. Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 08:51:56.769984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce3b317c-c2a8-494e-b218-8c5ad7462dc0 could not be found. Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce3b317c-c2a8-494e-b218-8c5ad7462dc0 could not be found. Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c21ff110-e518-4553-98f6-bf91ad3cdfec tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Returning 404 to user: Volume ce3b317c-c2a8-494e-b218-8c5ad7462dc0 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:56.772784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c21ff110-e518-4553-98f6-bf91ad3cdfec tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/ce3b317c-c2a8-494e-b218-8c5ad7462dc0" status: 404 len: 109 microversion: 2.1 time: 0.386321 Oct 04 08:51:56.778920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:51:56 2022] DELETE /compute/v2.1/os-volumes/ce3b317c-c2a8-494e-b218-8c5ad7462dc0 => generated 109 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:51:56.787919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a212f76b-baaf-414d-9808-7001b8811ae6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Calling method '.version_select at 0x7f6f1b28f3a0>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:51:56.877728 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-a212f76b-baaf-414d-9808-7001b8811ae6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] HTTP exception thrown: Volume c09d8f0d-3496-4c48-a8bd-285e968613db could not be found. Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a212f76b-baaf-414d-9808-7001b8811ae6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Request method failure captured: Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/os-volumes/c09d8f0d-3496-4c48-a8bd-285e968613db HTTP/1.1 Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_QpUiO6idNQ4jlrx65laF4xRs1_eYe7c__sYNZN4es5t04_v0PE7OskyR1vaEkfstTrorlzM1Fl7A6wBSeM2-WSoY2bcNhyEGArjt0H8WIbLtLYPHA3gb1gfZ2hyqpRHp4S0Gwa0AVyGXT7C-CqKvCSLCrBBy6mFrYlu_7zpDk4Diw Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:51:56.880274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2581751051d45deb15e3461411ec41e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2581751051d45deb15e3461411ec41e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2581751051d45deb15e3461411ec41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: d2581751051d45deb15e3461411ec41e Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-VolumesNegativeTest-974219681 Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 06065e7f3625480db47ef2f3e53aff85 Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-VolumesNegativeTest-974219681-project Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Volume c09d8f0d-3496-4c48-a8bd-285e968613db could not be found. Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'c09d8f0d-3496-4c48-a8bd-285e968613db'} Oct 04 08:51:56.881518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c09d8f0d-3496-4c48-a8bd-285e968613db could not be found. (HTTP 404) (Request-ID: req-708563b4-abd2-4b5b-9e5e-940bef509be4) Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.882263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:51:56.883587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c09d8f0d-3496-4c48-a8bd-285e968613db could not be found. Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:51:56.884638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c09d8f0d-3496-4c48-a8bd-285e968613db could not be found. Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c09d8f0d-3496-4c48-a8bd-285e968613db could not be found. Oct 04 08:51:56.885754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:51:56.886942 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a212f76b-baaf-414d-9808-7001b8811ae6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] Returning 404 to user: Volume c09d8f0d-3496-4c48-a8bd-285e968613db could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:51:56.888224 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a212f76b-baaf-414d-9808-7001b8811ae6 tempest-VolumesNegativeTest-974219681 tempest-VolumesNegativeTest-974219681-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c09d8f0d-3496-4c48-a8bd-285e968613db" status: 404 len: 109 microversion: 2.1 time: 0.104169 Oct 04 08:51:56.888996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:51:56 2022] GET /compute/v2.1/os-volumes/c09d8f0d-3496-4c48-a8bd-285e968613db => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:52:06.588587 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-59400e61-1047-4113-8906-30570060b022 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'create', calling method: .version_select at 0x7f6f1b2e4f70>, body: {"keypair": {"name": "tempest-keypair-1816089780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+dnwqyI6O02EXG+uPYs6+Qe+ajO4q5sOaDAFSYw2Hg9ICdlgwrNK5yII2Pmg9whgIfVUpaxQLciapgES8qERGxr4IIQdZNrLQbVzgP//Da6CELB9wSbGq2rX20+3q8fA=="}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:06.700035 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-59400e61-1047-4113-8906-30570060b022 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Getting quotas for project 3f3deef8b1cc4c9193e9357f0ba99e15. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:06.729546 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-59400e61-1047-4113-8906-30570060b022 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Getting quotas for user 835a297b6e75416ea9bd1a82b466b2a9 and project 3f3deef8b1cc4c9193e9357f0ba99e15. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:06.938743 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-59400e61-1047-4113-8906-30570060b022 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.925082 Oct 04 08:52:06.939974 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 5/9] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 4 08:52:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 927 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 08:52:11.899407 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-523301296", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "networks": [{"uuid": "f5144041-c12b-44c8-a534-32456f9ba9ba"}]}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:12.280060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.network.neutron [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] validate_networks() for [('f5144041-c12b-44c8-a534-32456f9ba9ba', None, None, None, None, None)] {{(pid=127549) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:52:13.588659 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-561070498", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:13.864698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] validate_networks() for [('ff082fc8-e1db-4811-948c-1101d0759e1f', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:52:14.648512 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Flavor limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:52:14.650587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Image limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:52:14.651299 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Flavor pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:52:14.651932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Image pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:52:14.652545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:52:14.686532 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.688204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.689111 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.691737 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:14.698168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:14.698735 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:14.762715 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Getting quotas for project 084b278155af4b28819357bcf190522d. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:14.776088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Getting quotas for user 1dcf55e151b94d379bcf21073f574af5 and project 084b278155af4b28819357bcf190522d. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:14.796668 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Going to run 1 instances... {{(pid=127549) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:52:14.799752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:52:15.012261 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-eb53a1c9-f410-4e71-b177-03b0d1124d4e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.193299 Oct 04 08:52:15.021206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 5/10] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 4203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:52:15.429949 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:52:15.430630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:52:15.431174 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:52:15.431946 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:52:15.432381 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:52:15.480232 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:15.480729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:15.481174 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:15.481943 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:15.482455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:15.482880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:15.536363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Getting quotas for project 24b4590edfe642bc8a8bd15a1b8ba464. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:15.543709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Getting quotas for user 185e359e571f44bda1585124529b36a8 and project 24b4590edfe642bc8a8bd15a1b8ba464. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:15.575790 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:52:15.578998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:52:15.750851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0cd1e521-92fe-4c19-8937-6a14818d5597 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: .version_select at 0x7f6f1a9975e0>, body: {"keypair": {"name": "tempest-keypair-1985041803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgBOhTekiI1Ahk33rcLqU1Tqs2TciiNvI6r3ZnhhgNYaUEihq8DR4xqjScznoLZj5JOBWVBBKZSkhzkGTaqh2K3pNGW8HwMssM2Z7BVktI/AZbAQQqW89ZUOJsuJbtPJw=="}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:15.781354 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b334e8bb-6d3f-4fa6-9acc-365a71fd0f66 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.866905 Oct 04 08:52:15.791561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 6/11] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:52:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:52:15.800139 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b0817499-5426-4619-851a-df5cb913e23b tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:15.803906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b0817499-5426-4619-851a-df5cb913e23b tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:15.879290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-0cd1e521-92fe-4c19-8937-6a14818d5597 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for project 8760be982f804a9aa319b989aa1c3118. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:15.899258 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-0cd1e521-92fe-4c19-8937-6a14818d5597 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for user 14d56042415540a3b3ed06578b712ca5 and project 8760be982f804a9aa319b989aa1c3118. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:16.075829 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b0817499-5426-4619-851a-df5cb913e23b tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:16.092317 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0cd1e521-92fe-4c19-8937-6a14818d5597 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.069362 Oct 04 08:52:16.093295 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 6/12] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:52:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:16.098352 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-010d955e-9ef9-446f-a4e4-b4b779a8cf10 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:16.102163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-010d955e-9ef9-446f-a4e4-b4b779a8cf10 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:16.144829 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b0817499-5426-4619-851a-df5cb913e23b tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1214 microversion: 2.1 time: 0.344901 Oct 04 08:52:16.144829 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:15 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1214 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:16.312899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-959535536", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19b6a461-a067-4350-add8-ace0265cc9ea"}], "security_groups": [{"name": "tempest-securitygroup--856701621"}], "key_name": "tempest-keypair-1816089780", "user_data": "}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:16.363488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-010d955e-9ef9-446f-a4e4-b4b779a8cf10 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:16.395400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-010d955e-9ef9-446f-a4e4-b4b779a8cf10 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1221 microversion: 2.1 time: 0.300786 Oct 04 08:52:16.406170 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:16 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1221 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:16.739037 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] validate_networks() for [('19b6a461-a067-4350-add8-ace0265cc9ea', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:52:17.032287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-496582251", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:17.154988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.network.neutron [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] validate_networks() for [('ff082fc8-e1db-4811-948c-1101d0759e1f', None, None, None, None, None)] {{(pid=127549) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:52:18.342493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:52:18.343629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:52:18.344272 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:52:18.345672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:52:18.346864 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:52:18.364850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.365352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.366104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.367624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.368238 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.368812 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.390073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Getting quotas for project 3f3deef8b1cc4c9193e9357f0ba99e15. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:18.397542 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Flavor limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:52:18.398227 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Getting quotas for user 835a297b6e75416ea9bd1a82b466b2a9 and project 3f3deef8b1cc4c9193e9357f0ba99e15. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:18.399179 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Image limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:52:18.400349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Flavor pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:52:18.401555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Image pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:52:18.402378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:52:18.410127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:52:18.412368 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:52:18.433639 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.434804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.436952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.438128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.439290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.441935 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.496506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Getting quotas for project 24b4590edfe642bc8a8bd15a1b8ba464. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:18.504175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Getting quotas for user 185e359e571f44bda1585124529b36a8 and project 24b4590edfe642bc8a8bd15a1b8ba464. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:18.561245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Going to run 1 instances... {{(pid=127549) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:52:18.567091 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:52:18.649748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0447cd0c-b9b3-489f-acb2-80597ea843c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.344742 Oct 04 08:52:18.651047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 8/15] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 4 08:52:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 08:52:18.656493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:18.657566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:18.673213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.674973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.676102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.676832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:18.677298 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:18.677761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:18.823071 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fca603fc-d87d-46e8-a57b-0ca078e0b334 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.795066 Oct 04 08:52:18.831166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 8/16] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:52:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:52:18.853549 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1c51d6ef-eb2c-4d80-b49d-b4a2e1b65bdd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:18.859679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1c51d6ef-eb2c-4d80-b49d-b4a2e1b65bdd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:19.093485 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.111679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0de689cd-2487-4f9d-ad09-721055d2a752 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1218 microversion: 2.1 time: 0.459380 Oct 04 08:52:19.112268 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 9/17] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:18 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1218 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:19.139540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-141e8772-e789-45bd-ae8d-865021512808 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:19.140269 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-141e8772-e789-45bd-ae8d-865021512808 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:19.270508 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1c51d6ef-eb2c-4d80-b49d-b4a2e1b65bdd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.280844 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1c51d6ef-eb2c-4d80-b49d-b4a2e1b65bdd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.297115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1c51d6ef-eb2c-4d80-b49d-b4a2e1b65bdd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.298362 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1c51d6ef-eb2c-4d80-b49d-b4a2e1b65bdd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1281 microversion: 2.20 time: 0.466128 Oct 04 08:52:19.299075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 9/18] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:18 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1281 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:19.395725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-141e8772-e789-45bd-ae8d-865021512808 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:19.403771 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-141e8772-e789-45bd-ae8d-865021512808 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1221 microversion: 2.1 time: 0.290477 Oct 04 08:52:19.404358 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 10/19] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:19 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1221 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:20.151273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:20.152633 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:20.160404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.161211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.161825 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.164150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.164906 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.165519 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.328097 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-11427b80-f4a4-4749-ae92-aef605e25902 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:20.331023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-11427b80-f4a4-4749-ae92-aef605e25902 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:20.547643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-11427b80-f4a4-4749-ae92-aef605e25902 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.559245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-11427b80-f4a4-4749-ae92-aef605e25902 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.561150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-11427b80-f4a4-4749-ae92-aef605e25902 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.562440 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-11427b80-f4a4-4749-ae92-aef605e25902 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1281 microversion: 2.20 time: 0.240375 Oct 04 08:52:20.581460 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:20 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:20.587782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:20.591875 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:20.604659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.626534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.627109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.627557 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.628289 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:20.628747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:20.629190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:20.638270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a481f7c2-3b92-4ec9-9881-e08e9279047e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1266 microversion: 2.1 time: 0.496499 Oct 04 08:52:20.641494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 10/21] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:20 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1266 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:20.827833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:20.838822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9568ff36-c0c2-4474-abf8-43ad31273793 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1225 microversion: 2.1 time: 0.255454 Oct 04 08:52:20.839683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 12/22] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:20 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1225 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:21.364689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-904798173", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38eace1c-70a5-4e3a-880c-50986fb2cf27"}], "security_groups": [{"name": "tempest-securitygroup--1888149535"}], "key_name": "tempest-keypair-1985041803", "user_data": "}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:21.531846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.network.neutron [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] validate_networks() for [('38eace1c-70a5-4e3a-880c-50986fb2cf27', None, None, None, None, None)] {{(pid=127549) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:52:21.588050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:21.588934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:21.620579 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.626295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.626295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.626295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.626295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.626675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.789185 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:21.814197 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:21.830202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:21.831629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5435a78b-8ac4-440a-ab05-5631b1115a98 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1277 microversion: 2.20 time: 0.247437 Oct 04 08:52:21.844617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 13/23] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:21 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:21.846756 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:21.847357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:21.878737 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.879454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.880044 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:21.881617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:21.882308 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:21.883290 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.488578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:22.516830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-844a7245-f515-4ae6-b347-db4166f47274 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1272 microversion: 2.1 time: 0.668093 Oct 04 08:52:22.522938 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 14/24] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:21 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1272 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:22.525092 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:22.525721 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:22.555446 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.555965 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.556422 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.557145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.557613 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.558054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.737874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:22.771256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4bed2df1-a65d-40fe-9b2b-351b26491dbb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1273 microversion: 2.1 time: 0.244652 Oct 04 08:52:22.771256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 15/25] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:22 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:22.850885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Flavor limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:52:22.851610 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Image limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:52:22.852308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Flavor pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:52:22.853354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Image pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:52:22.854702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:52:22.870046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:22.871215 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:22.872057 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.872609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.873285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.875528 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.876289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.876929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.880548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.881218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.882734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.883709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:22.884732 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:22.885178 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:22.900163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for project 8760be982f804a9aa319b989aa1c3118. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:52:22.911077 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for user 14d56042415540a3b3ed06578b712ca5 and project 8760be982f804a9aa319b989aa1c3118. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:52:22.930200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Going to run 1 instances... {{(pid=127549) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:52:22.948881 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:52:23.031543 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:23.040007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:23.049660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:23.054458 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5eb30452-ef39-4a48-9829-cde5efb843fd tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1277 microversion: 2.20 time: 0.187894 Oct 04 08:52:23.059635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 16/26] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:22 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:23.146881 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0e68a674-0ec5-4822-bfa4-e0da2a5cdc9b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.786845 Oct 04 08:52:23.147870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 11/27] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:52:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:52:23.160178 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9612f6d2-0309-4401-b54d-9b75808007e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:23.160799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9612f6d2-0309-4401-b54d-9b75808007e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:23.301090 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9612f6d2-0309-4401-b54d-9b75808007e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:23.310017 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9612f6d2-0309-4401-b54d-9b75808007e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1241 microversion: 2.1 time: 0.154411 Oct 04 08:52:23.314467 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 17/28] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:23 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:23.541462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:23.542669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:23.554348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.560522 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.561343 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.562205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.562839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.567432 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.798519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:23.799834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:23.837613 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.842860 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.848093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:23.848093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:23.848093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:23.848093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:24.116104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.136124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7f0670c5-0850-4eec-9d55-be4d991be96a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1279 microversion: 2.1 time: 0.344702 Oct 04 08:52:24.136733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 18/29] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:23 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1279 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:24.147943 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:24.156163 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:24.191498 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:24.197565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:24.205234 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:24.209474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:24.209996 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:24.210576 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:24.316410 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.334559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e6c04f0f-88a5-4df8-9769-bf40755f05ea tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.796982 Oct 04 08:52:24.337480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 12/30] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:23 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:24.355867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1683064c-c1ab-4cb9-8de1-9e86f0fcc2ba tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:24.549732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1683064c-c1ab-4cb9-8de1-9e86f0fcc2ba tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:24.552548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.552548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.553181 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.553181 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-580ce623-76ad-4b20-88b3-31dba1c3019f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1341 microversion: 2.20 time: 0.317206 Oct 04 08:52:24.553181 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 19/31] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:24 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1341 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:24.553497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1683064c-c1ab-4cb9-8de1-9e86f0fcc2ba tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:24.553497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1683064c-c1ab-4cb9-8de1-9e86f0fcc2ba tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1241 microversion: 2.1 time: 0.139941 Oct 04 08:52:24.553497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 13/32] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:24 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:25.166346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:25.175579 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:25.214881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.214881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.214881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.214881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.215388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.215388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.362938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:25.363504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:25.387238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.389639 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.390298 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.396330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.397346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.398932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.445674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:25.463913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b1b7d684-be47-42cc-8aa0-aadac744f9be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1279 microversion: 2.1 time: 0.299400 Oct 04 08:52:25.463913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 20/33] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:25 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1279 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:25.574481 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:25.577155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:25.596569 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.598102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.600861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.603789 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.605468 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.607149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.752398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:25.768049 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-16f6b2b1-3a39-410b-b5a8-02f182531faf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1237 microversion: 2.1 time: 0.200312 Oct 04 08:52:25.784611 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 21/34] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:25 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1237 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:25.794934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:25.795605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:25.824171 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.824697 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.825177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:25.825892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:25.826347 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:25.826793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.052238 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.071360 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.085007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.085007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bfcbd3e1-fe06-4ebc-a8fb-831477b59093 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1339 microversion: 2.20 time: 0.308074 Oct 04 08:52:26.085007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 22/35] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:25 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:26.220247 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:26.240734 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d67e9b48-8493-4682-be3c-081a33d8bbb2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.881893 Oct 04 08:52:26.259463 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 14/36] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:25 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:26.489492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:26.489492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:26.509820 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.510768 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.510914 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.511542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.512019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.526638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.800191 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:26.802661 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:26.815847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.816688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.818667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:26.824348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:26.825252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:26.829439 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.062834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.076780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-81a3f6e6-621d-4e0d-b6e0-3a9fe37e8f81 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1279 microversion: 2.1 time: 0.594835 Oct 04 08:52:27.085083 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 23/37] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:26 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1279 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:27.113445 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.119796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.127898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.128546 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.128977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.129855 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.130729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.131147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.183943 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.193620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5b7a3e9e-067b-4797-b8ca-af6edfe3f398 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1293 microversion: 2.1 time: 0.397999 Oct 04 08:52:27.198333 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 15/38] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:26 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1293 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:27.278764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:27.281647 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:27.289895 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.304785 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.308780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.312822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.314765 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:27.316625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:27.320072 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:27.325301 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.330710 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.338644 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bf2e0327-b2ef-42a1-b6b2-93df470a328b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1339 microversion: 2.20 time: 0.227006 Oct 04 08:52:27.341650 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 24/39] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:27 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:27.698558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:27.723314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-64ba0b8e-00ac-4583-a311-e38cb2c92667 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.451586 Oct 04 08:52:27.735478 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 16/40] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:27 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:28.107664 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:28.109101 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:28.148110 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.150172 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.151752 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.156266 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.158303 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.160299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.256452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:28.256452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:28.256452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.256452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.257488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.257488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.274277 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.282726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.377088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=4 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:28.699699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:28.727199 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c81c638c-a69a-4590-8cd1-cce647555b06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1299 microversion: 2.1 time: 0.487043 Oct 04 08:52:28.727199 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 17/41] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:28 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1299 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:28.727199 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:28.727199 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:28.745441 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.750637 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.750637 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.750637 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.751128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.751567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.937758 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:28.950681 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-34c20294-8be2-4ccb-8eba-c360c7fbefba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.844929 Oct 04 08:52:28.969511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 25/42] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:28 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:28.983566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:28.983566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:28.995554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:28.995554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:28.998655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:28.999446 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.000716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.003030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.284183 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.314614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.318994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.323022 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:29.338717 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-aa9f1d82-5bb3-4e3c-ac4b-154776b7104e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.609591 Oct 04 08:52:29.338717 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 18/43] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:28 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:29.339107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-be5cc291-4a08-45ac-9872-6525c2c2f8c4 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.359128 Oct 04 08:52:29.350610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 26/44] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:28 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:29.739581 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:29.740564 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:29.750141 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.751252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.763520 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.765062 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.765754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:29.768151 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:29.979179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:29.980548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:29.997346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:29.997714 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.001947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.004531 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.005025 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.005726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.056055 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:30.073015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5a4ab1fb-f880-419f-8254-1a9872f8290c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1299 microversion: 2.1 time: 0.339500 Oct 04 08:52:30.076289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 19/45] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:29 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1299 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:30.602168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:30.602168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:30.602168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-122d4339-b435-4562-957f-091a6fb6897a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.600928 Oct 04 08:52:30.602168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 27/46] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:29 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:30.602977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:30.602977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:30.602977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.602977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.603275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:30.603275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:30.603275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:30.603275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.090782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.118507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ff5d238f-50b4-4b97-b40c-ab625896400d tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.535719 Oct 04 08:52:31.118507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 28/47] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:30 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:31.133989 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:31.135454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:31.157809 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.202716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.228801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.235491 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.236317 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.240111 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.307453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-51fa3942-0efd-4b42-8188-464a341f9cb7 req-bbd3e420-0c99-41ad-aaec-98e183bd9f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb", "tag": "463f6f66-9c4c-42ef-b207-c2df5e8523b5"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:31.354222 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-51fa3942-0efd-4b42-8188-464a341f9cb7 req-bbd3e420-0c99-41ad-aaec-98e183bd9f4e service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.355923 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-51fa3942-0efd-4b42-8188-464a341f9cb7 req-bbd3e420-0c99-41ad-aaec-98e183bd9f4e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.356522 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-51fa3942-0efd-4b42-8188-464a341f9cb7 req-bbd3e420-0c99-41ad-aaec-98e183bd9f4e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.395340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-51fa3942-0efd-4b42-8188-464a341f9cb7 req-bbd3e420-0c99-41ad-aaec-98e183bd9f4e service nova] Creating event network-changed:463f6f66-9c4c-42ef-b207-c2df5e8523b5 for instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb on hv-cinder-85944 Oct 04 08:52:31.397416 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-51fa3942-0efd-4b42-8188-464a341f9cb7 req-bbd3e420-0c99-41ad-aaec-98e183bd9f4e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127549) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 08:52:31.398177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-51fa3942-0efd-4b42-8188-464a341f9cb7 req-bbd3e420-0c99-41ad-aaec-98e183bd9f4e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127549) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 08:52:31.403173 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.405233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.405233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.407187 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.408166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.410050 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.438600 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.compute.rpcapi [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 08:52:31.440958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=127549) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 08:52:31.484493 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-86f49e9b-1a40-43bc-af87-ad1f7ef9c6d8 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.203789 Oct 04 08:52:31.485875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 20/48] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:31.498010 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:31.499086 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:31.509877 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.510318 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.511278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.512594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.513586 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.514171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.708238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.720443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-64b0f948-e9f8-445b-b37b-e767f2e35a1b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1299 microversion: 2.1 time: 0.231546 Oct 04 08:52:31.723404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 21/49] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:31 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1299 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:31.730082 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:31.731226 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:31.738127 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.738839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.739664 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.740718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:31.743463 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:31.757510 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:31.907878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.957244 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.968476 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:31.972089 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9e048d78-ee79-4291-9b6f-23147f360140 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.854270 Oct 04 08:52:31.984380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 29/50] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:31 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:32.140279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:32.142322 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:32.155776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:32.161519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.164593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.173249 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.174225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.176099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.176699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.187948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.197411 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4ee9a9d5-502c-4e72-8f03-e5c811dce98d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.472905 Oct 04 08:52:32.199570 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 22/51] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:31 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:32.463271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-ea1158cb-8f3f-4ec9-acd3-7ef24525dd46 req-e28d1cb1-5e81-4688-ba29-fc861ca0f970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07087473-a629-4720-abc6-c514a5120511", "tag": "3204e9c4-8fba-47f2-b86e-dfd24301d3c6"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:32.488510 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-ea1158cb-8f3f-4ec9-acd3-7ef24525dd46 req-e28d1cb1-5e81-4688-ba29-fc861ca0f970 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.488995 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-ea1158cb-8f3f-4ec9-acd3-7ef24525dd46 req-e28d1cb1-5e81-4688-ba29-fc861ca0f970 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.489421 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-ea1158cb-8f3f-4ec9-acd3-7ef24525dd46 req-e28d1cb1-5e81-4688-ba29-fc861ca0f970 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.528876 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-ea1158cb-8f3f-4ec9-acd3-7ef24525dd46 req-e28d1cb1-5e81-4688-ba29-fc861ca0f970 service nova] Creating event network-changed:3204e9c4-8fba-47f2-b86e-dfd24301d3c6 for instance 07087473-a629-4720-abc6-c514a5120511 on hv-cinder-85944 Oct 04 08:52:32.534309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-ea1158cb-8f3f-4ec9-acd3-7ef24525dd46 req-e28d1cb1-5e81-4688-ba29-fc861ca0f970 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303792 Oct 04 08:52:32.567336 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 23/52] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:32.705428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:32.720898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8de9fca7-d3b6-416e-b5a4-ae380437fd67 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.584761 Oct 04 08:52:32.724866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 30/53] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:32 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:32.753869 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:32.764982 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:32.771278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:32.791005 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.791441 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.791862 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:32.792590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:32.793052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:32.793480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.018611 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:33.019246 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:33.038759 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.039266 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.039714 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.040430 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.051261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.051825 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.309749 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=24 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:33.424330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.446682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-828bb149-a2a9-491a-8540-743481847cb1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.690789 Oct 04 08:52:33.475128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 24/54] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:32 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:33.488848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:33.491641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:33.514606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.515497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.516410 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.517726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.518190 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.520029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.603809 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.637553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.643085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.645303 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5347b913-fcbb-47ac-a3cf-f176af72fabf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.642948 Oct 04 08:52:33.646813 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 31/55] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:33 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:33.753124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:33.754834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:33.768246 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.768767 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.769293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.774720 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:33.775311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:33.778209 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:33.937120 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:33.952905 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6f6ddff9-2300-4a2e-9f06-65183aca05f2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.476027 Oct 04 08:52:33.954259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 25/56] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:33 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:34.071646 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:34.086085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6aeca760-ea25-4d96-98b9-0547569f68cd tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.335538 Oct 04 08:52:34.106890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 32/57] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:33 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:34.479431 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:34.481629 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:34.487662 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=28 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:34.499317 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.499811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.505060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.505060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.505060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.505060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.653261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-8db5dbf0-7066-4c0f-8368-663f488da9cf req-07c4eb8c-62d7-4441-af82-f6f1cf731f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acaf703d-ba5c-4518-a5d9-afa1a34dcfd1", "tag": "e0969193-60ee-4fb7-ba1b-70b50bfb9b9d"}, {"name": "network-changed", "server_uuid": "77980831-3790-419c-be64-5c42d888ff49", "tag": "ff4cfcd1-064d-4a58-a5bd-20180f00f6f5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:34.690795 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8db5dbf0-7066-4c0f-8368-663f488da9cf req-07c4eb8c-62d7-4441-af82-f6f1cf731f62 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.691283 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8db5dbf0-7066-4c0f-8368-663f488da9cf req-07c4eb8c-62d7-4441-af82-f6f1cf731f62 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.691711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8db5dbf0-7066-4c0f-8368-663f488da9cf req-07c4eb8c-62d7-4441-af82-f6f1cf731f62 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.760413 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-8db5dbf0-7066-4c0f-8368-663f488da9cf req-07c4eb8c-62d7-4441-af82-f6f1cf731f62 service nova] Creating event network-changed:e0969193-60ee-4fb7-ba1b-70b50bfb9b9d for instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 on hv-cinder-85944 Oct 04 08:52:34.760918 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-8db5dbf0-7066-4c0f-8368-663f488da9cf req-07c4eb8c-62d7-4441-af82-f6f1cf731f62 service nova] Creating event network-changed:ff4cfcd1-064d-4a58-a5bd-20180f00f6f5 for instance 77980831-3790-419c-be64-5c42d888ff49 on hv-cinder-85944 Oct 04 08:52:34.761447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8db5dbf0-7066-4c0f-8368-663f488da9cf req-07c4eb8c-62d7-4441-af82-f6f1cf731f62 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 08:52:34.767692 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8db5dbf0-7066-4c0f-8368-663f488da9cf req-07c4eb8c-62d7-4441-af82-f6f1cf731f62 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 08:52:34.767692 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.769698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.771470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.773926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.776401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.777692 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.800648 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.compute.rpcapi [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 08:52:34.801031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:34.802270 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] Releasing lock "compute-rpcapi-router" {{(pid=127548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 08:52:34.828021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-96ea2564-7e14-429f-976f-a921e4022fd5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.358185 Oct 04 08:52:34.829526 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 26/58] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:34 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:34.838054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:34.839126 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:34.849211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.854948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.854948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.854948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:34.854948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:34.856641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:34.864324 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-14fb24d2-085f-4b87-afaf-d17770bcee74 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.217990 Oct 04 08:52:34.865236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 33/59] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:34.991667 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:34.992395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:35.005148 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.005908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.006652 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.009358 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.009992 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.011549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.145008 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.159129 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.175406 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.182325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1ed533cf-ac8d-474e-a32a-c0f41b04da94 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.348870 Oct 04 08:52:35.182325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 27/60] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:34 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:35.194931 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:35.196385 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:35.225775 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.226879 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.227731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.229029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.230318 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.232052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.274296 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:35.434629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.445898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-158d0b07-d1f3-4600-b408-c736268def58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.459788 Oct 04 08:52:35.446816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 34/61] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:34 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:35.494175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:35.502643 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-534f2206-d043-4cbb-a7d5-846c73f31ee5 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.320241 Oct 04 08:52:35.503261 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 28/62] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:35 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:35.855436 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:35.856708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:35.869106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.872855 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.873764 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:35.875090 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:35.885886 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:35.887589 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.145327 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.160324 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8311f8f6-0ae8-495e-85c0-32104de2efc4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.310978 Oct 04 08:52:36.174867 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 35/63] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:35 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:36.223336 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:36.223959 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:36.232117 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.244827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.244827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.244827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.244827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.245386 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.457495 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.472699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.477573 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:36.478666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:36.480310 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:36.483204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-dc18dc52-ed46-46fc-922b-d7c0d13b9735 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.264218 Oct 04 08:52:36.490735 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.491882 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.492419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.493393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.494091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.494741 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.510031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 29/64] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:36 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:36.528823 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:36.529460 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:36.540779 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.541428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.541664 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:36.542379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:36.542887 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:36.543272 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.118584 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.133166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.139655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-45290a37-3898-4d89-9a9b-e1e23e95ac9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.669128 Oct 04 08:52:37.140869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 36/65] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:36 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:37.159139 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7c9ee11c-463e-4297-b377-05f21618c041 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.633909 Oct 04 08:52:37.160947 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 30/66] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:36 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:37.181465 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-5bcee4c7-9385-426a-a93d-d50b35ea1e57 req-359c8aa4-4e55-4ff7-9c58-62487d621c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a71a25f-8f53-4c71-8f61-9687de80f727", "tag": "6b040ace-0eaf-4833-81ba-09cdfc978084"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:37.202306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:37.208065 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:37.222487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5bcee4c7-9385-426a-a93d-d50b35ea1e57 req-359c8aa4-4e55-4ff7-9c58-62487d621c61 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.222973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5bcee4c7-9385-426a-a93d-d50b35ea1e57 req-359c8aa4-4e55-4ff7-9c58-62487d621c61 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.223409 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5bcee4c7-9385-426a-a93d-d50b35ea1e57 req-359c8aa4-4e55-4ff7-9c58-62487d621c61 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.225775 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.230163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.230802 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.236746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.236746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.236746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.277127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-5bcee4c7-9385-426a-a93d-d50b35ea1e57 req-359c8aa4-4e55-4ff7-9c58-62487d621c61 service nova] Creating event network-changed:6b040ace-0eaf-4833-81ba-09cdfc978084 for instance 1a71a25f-8f53-4c71-8f61-9687de80f727 on hv-cinder-85944 Oct 04 08:52:37.299003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-5bcee4c7-9385-426a-a93d-d50b35ea1e57 req-359c8aa4-4e55-4ff7-9c58-62487d621c61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122689 Oct 04 08:52:37.299614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 37/67] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:37.515460 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:37.517127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:37.529786 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.536088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.536088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.536088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:37.536088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:37.536422 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:37.586592 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.596842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9ad209d3-3ad4-4032-8aa8-46a2c4d78c9c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.409138 Oct 04 08:52:37.601406 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 31/68] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:37 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:37.774915 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.793762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.801195 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:37.804095 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1e3da27c-34f7-4afb-9328-d4b6ae4098cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.293469 Oct 04 08:52:37.823522 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 38/69] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:37 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:38.171206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:38.171861 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:38.187250 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.187857 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.193253 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:38.194916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:38.200696 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.201192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.201677 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.202108 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.205115 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.208068 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.209540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.210791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.211254 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.211683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.489108 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:38.495866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:38.503770 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2b1605ca-e255-41c4-af3a-c7dcab53d932 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.314229 Oct 04 08:52:38.505019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 39/70] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:38 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:38.506789 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7f0f4a5d-82b5-46d6-8691-58c40308c4a1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.344512 Oct 04 08:52:38.522962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 32/71] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:38 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:38.626725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:38.627412 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:38.636083 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.636577 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.636994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.637686 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.638136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.638586 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.829711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:38.836061 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:38.837913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:38.840228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-127c71ae-e8a4-4f02-abce-3ef72c4da726 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.216929 Oct 04 08:52:38.840228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 40/72] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:38 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:38.845652 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.846571 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.847129 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.847910 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:38.848586 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:38.849237 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:38.997367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:39.005886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:39.009281 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:39.010686 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-56a4ecfa-8a4b-41f6-8ea6-7a01f2b68ff6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.182021 Oct 04 08:52:39.011598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 33/73] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:38 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:39.529819 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:39.530384 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:39.536351 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.537092 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.537329 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.537965 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.538816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.544551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.544826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:39.545446 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:39.554544 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.555441 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.556134 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.557196 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.557675 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.558282 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.893554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:39.902256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:39.908571 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a4086976-9f36-4bc2-891c-52f16c31300b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.367745 Oct 04 08:52:39.909919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 34/74] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:39 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:39.911071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5c37374a-cc50-4bee-a72a-acadf2700b3e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.385269 Oct 04 08:52:39.911638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 41/75] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:39 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:39.916543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:39.917328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:39.926330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.929168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.929168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:39.929796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:39.930272 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:39.930744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.041235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:40.041850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:40.049396 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.052635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.053245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.054697 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.057955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.058640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.263444 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.284082 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-87c2f48c-d27a-42d0-a915-8c9bad94c120 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.372910 Oct 04 08:52:40.284658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 35/76] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:39 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:40.331457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.343581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.345903 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:40.347349 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a50c6228-68d0-427e-8c04-873e591f2c1b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.309974 Oct 04 08:52:40.348093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 42/77] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:40 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:40.935271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:40.935881 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:40.942547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.943040 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.943343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:40.943786 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.944249 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:40.944459 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.944915 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.945344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.951836 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.952818 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.953606 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:40.954448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:40.955008 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:40.955500 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.217611 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.234011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5563a9c4-dad3-404e-a1b2-c164a07cde17 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.294459 Oct 04 08:52:41.235711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 43/78] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:40 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:41.247792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.259275 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4cec4de5-2619-4ed3-8b77-5dbc3a791cd1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.328926 Oct 04 08:52:41.261506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 36/79] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:40 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:41.308183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:41.309065 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:41.315013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.315766 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.316317 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.317098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.319437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.319437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.376554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:41.377647 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:41.386603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.390393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.390393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.390393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:41.391533 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:41.392182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:41.701416 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=8 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:41.703447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.703447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-158a1ab5-2a9e-44d3-a99b-8ce16051eb7e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.264135 Oct 04 08:52:41.703447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 44/80] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:41 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:41.704666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.704666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.705216 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:41.705216 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8c433833-fde0-4ede-ba87-7dab8c651f67 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.273626 Oct 04 08:52:41.705216 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 37/81] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:41 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:42.271081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:42.271081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:42.280527 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.281892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.282638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.283798 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.284491 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.294506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:42.295839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:42.303150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.313192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.315531 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.316483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.318180 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.319930 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.321708 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.359687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:42.675511 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.682600 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:42.687767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4f424682-9215-4305-be13-20a3210ab839 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.401126 Oct 04 08:52:42.688389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 38/82] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:42 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:42.695449 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:42.696053 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:42.701945 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3a7561df-cae1-4ece-9181-a62aecdf4ea2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.442750 Oct 04 08:52:42.720691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 45/83] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:42 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:42.720787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.721083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.721520 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.722221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.722706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.723182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.728799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:42.729459 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:42.737242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.737714 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.738151 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:42.738884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:42.739474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:42.739906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.045631 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:43.057331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:43.058851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:43.059435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:43.061328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c68286f2-9d38-4d44-acb7-1effc1d5679c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.347089 Oct 04 08:52:43.062342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 46/84] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:42 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:43.068700 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-279045e1-7f2d-4ad9-9c5e-565ccf224bd8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.379272 Oct 04 08:52:43.069548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 39/85] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:42 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:43.711869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:43.712343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:43.718866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.719567 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.720007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.721347 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.721428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.721804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.735003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:43.735003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:43.742046 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.742732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.743557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.745580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:43.746153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:43.747337 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:43.998015 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.012754 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-428875ea-176d-49ba-8e5f-231f660cdce9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.304926 Oct 04 08:52:44.015912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 47/86] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:43 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:44.082637 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.097330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-db3540f3-18e6-4eca-8512-6d3032be9f38 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.372891 Oct 04 08:52:44.098348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 40/87] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:43 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:44.101046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:44.102132 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:44.114201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:44.114977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:44.115167 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:44.115851 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:44.116357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:44.121444 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:44.122187 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:44.122323 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:44.122855 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:44.123230 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:44.125000 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:44.127956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:44.128623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:44.129264 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:44.361088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.369076 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.378021 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.379928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:44.381581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bf6806af-9cef-46e5-a52e-f16adcb0b860 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.295585 Oct 04 08:52:44.382793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 48/88] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:44 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:44.383665 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-04018022-d904-4504-9bbb-66bfb663029b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.281122 Oct 04 08:52:44.384245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 41/89] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:44 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:45.035723 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:45.036868 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:45.040586 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:45.044062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.044642 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.044956 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.045808 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.046437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.046945 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.127655 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:45.128549 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:45.136256 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.136983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.137589 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.138783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.139394 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.140248 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.224357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.246242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-03126dca-fba8-4bb5-a389-13e202fdf63c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.214283 Oct 04 08:52:45.246796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 49/90] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:45 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:45.316356 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.325277 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c09653ec-fdb4-4e88-ac7f-bdcfccd52875 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.204987 Oct 04 08:52:45.326462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 42/91] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:45 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:45.407615 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:45.408589 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:45.419234 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.419889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.420428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.421234 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.423297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:45.423895 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.424434 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.426733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:45.439299 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.447270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.447786 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.448435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:45.448896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:45.449339 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:45.640450 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.651899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-175a8766-97fc-4c4e-aeb9-c97799ff4d34 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.248269 Oct 04 08:52:45.653185 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 50/92] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:45 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:45.657394 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.669544 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.679781 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:45.680719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-00b6a007-02af-4ef6-8719-f65af54ca409 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.268232 Oct 04 08:52:45.681491 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 43/93] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:45 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:46.270754 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:46.277035 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:46.280877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.281366 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.281989 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.282951 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.283300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.283814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.349508 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:46.350138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:46.356131 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.356610 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.357215 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.358822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.359619 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.360227 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.567697 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.580007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-54e984ac-07c9-47d3-9570-b4b1083a792b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.313767 Oct 04 08:52:46.580867 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 51/94] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:46 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:46.619057 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:46.626858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-12f11943-7dc5-4ef8-95b5-c8faa67804cc tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.281237 Oct 04 08:52:46.627417 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 44/95] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:46 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:46.678908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:46.679950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:46.688270 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.689311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.689427 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.690154 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.690656 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.691082 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.708323 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:46.708323 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:46.717507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.723194 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.723971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.725130 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:46.725814 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:46.731445 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:46.754532 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:46.988183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.001139 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2171548e-d71e-4005-ab35-34d5635bc653 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.326786 Oct 04 08:52:47.001846 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 52/96] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:46 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:47.018665 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.027701 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.029360 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.030697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e36f597d-67db-4f18-b1e7-67984a70df89 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.327985 Oct 04 08:52:47.031555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 45/97] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:46 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:47.610616 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:47.611732 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:47.618006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.618605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.619319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.620202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.620850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.621600 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.653269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:47.653892 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:47.660566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.660741 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.661353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.663229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:47.663922 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:47.672860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:47.882126 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.891638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4c5c46c1-a826-451f-a204-5f941aac6982 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.284763 Oct 04 08:52:47.892353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 53/98] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:47 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:47.894288 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:47.907595 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1b51adf5-513b-4228-b842-f05b9af1ed5e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.258923 Oct 04 08:52:47.908780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 46/99] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:47 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:48.031492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:48.032204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:48.043215 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.045464 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.047151 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.048181 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.049943 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.051109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.139027 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-ceff57cb-0ef8-4c84-b708-81d200c72446 req-b50a5538-ecaa-4e95-b6d8-4fc2a5dd8630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb", "name": "network-vif-plugged", "status": "completed", "tag": "463f6f66-9c4c-42ef-b207-c2df5e8523b5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:48.151129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ceff57cb-0ef8-4c84-b708-81d200c72446 req-b50a5538-ecaa-4e95-b6d8-4fc2a5dd8630 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.152236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ceff57cb-0ef8-4c84-b708-81d200c72446 req-b50a5538-ecaa-4e95-b6d8-4fc2a5dd8630 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.152584 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ceff57cb-0ef8-4c84-b708-81d200c72446 req-b50a5538-ecaa-4e95-b6d8-4fc2a5dd8630 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.167171 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-ceff57cb-0ef8-4c84-b708-81d200c72446 req-b50a5538-ecaa-4e95-b6d8-4fc2a5dd8630 service nova] Creating event network-vif-plugged:463f6f66-9c4c-42ef-b207-c2df5e8523b5 for instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb on hv-cinder-85944 Oct 04 08:52:48.180480 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-ceff57cb-0ef8-4c84-b708-81d200c72446 req-b50a5538-ecaa-4e95-b6d8-4fc2a5dd8630 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286604 Oct 04 08:52:48.182752 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 54/100] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:48.189443 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:48.191785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:48.201739 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.203495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.204349 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.205438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.206586 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.207644 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.253714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:48.263587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-182e5440-34e4-4a25-b5d9-38fa73fa3db5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.239855 Oct 04 08:52:48.265673 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 47/101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:48 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:48.424021 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:48.434373 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:48.435924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:48.437039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d3391a5d-40aa-49db-9a25-3a0a6a30a059 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.253199 Oct 04 08:52:48.437656 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 55/102] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:48 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:48.915627 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:48.916157 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:48.922305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.924321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.924321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.924321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.924547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.924933 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.934319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:48.934954 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:48.946163 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.946905 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.952942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:48.952942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:48.952942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:48.952942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.126819 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.137479 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-77180976-0516-4573-aec4-cd7d414d8dcb tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.226938 Oct 04 08:52:49.153547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 48/103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:48 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:49.171009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.179494 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ff998161-6285-490d-930b-e53bd801678a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.249202 Oct 04 08:52:49.191889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 56/104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:48 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:49.291343 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:49.291965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:49.300709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.301521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.302382 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.303325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.304322 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.304899 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.463040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:49.463907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:49.472223 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.472874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.473690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.474390 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:49.475728 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:49.476529 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:49.484287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.493175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-74144584-e5d5-4479-a5b4-dd21c4d75ef0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.208165 Oct 04 08:52:49.493886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 49/105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:49 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:49.646370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.658451 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.660206 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:49.661323 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-88045b58-53e3-4bf2-aa9d-414f36e7b0b2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.203389 Oct 04 08:52:49.662194 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 57/106] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:49 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:52:50.160996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:50.161835 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:50.169154 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.169665 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.170101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.170840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.171431 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.171984 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.203183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-59da3b4f-5330-49b4-8daf-a9ec590f5ef2 req-1bb94f0c-917d-4920-9f95-316fb126a223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acaf703d-ba5c-4518-a5d9-afa1a34dcfd1", "name": "network-vif-plugged", "status": "completed", "tag": "e0969193-60ee-4fb7-ba1b-70b50bfb9b9d"}, {"server_uuid": "07087473-a629-4720-abc6-c514a5120511", "name": "network-vif-plugged", "status": "completed", "tag": "3204e9c4-8fba-47f2-b86e-dfd24301d3c6"}, {"server_uuid": "77980831-3790-419c-be64-5c42d888ff49", "name": "network-vif-plugged", "status": "completed", "tag": "ff4cfcd1-064d-4a58-a5bd-20180f00f6f5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:50.214691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-59da3b4f-5330-49b4-8daf-a9ec590f5ef2 req-1bb94f0c-917d-4920-9f95-316fb126a223 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.215170 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-59da3b4f-5330-49b4-8daf-a9ec590f5ef2 req-1bb94f0c-917d-4920-9f95-316fb126a223 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.215593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-59da3b4f-5330-49b4-8daf-a9ec590f5ef2 req-1bb94f0c-917d-4920-9f95-316fb126a223 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.230935 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-59da3b4f-5330-49b4-8daf-a9ec590f5ef2 req-1bb94f0c-917d-4920-9f95-316fb126a223 service nova] Creating event network-vif-plugged:e0969193-60ee-4fb7-ba1b-70b50bfb9b9d for instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 on hv-cinder-85944 Oct 04 08:52:50.231436 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-59da3b4f-5330-49b4-8daf-a9ec590f5ef2 req-1bb94f0c-917d-4920-9f95-316fb126a223 service nova] Creating event network-vif-plugged:3204e9c4-8fba-47f2-b86e-dfd24301d3c6 for instance 07087473-a629-4720-abc6-c514a5120511 on hv-cinder-85944 Oct 04 08:52:50.231933 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-59da3b4f-5330-49b4-8daf-a9ec590f5ef2 req-1bb94f0c-917d-4920-9f95-316fb126a223 service nova] Creating event network-vif-plugged:ff4cfcd1-064d-4a58-a5bd-20180f00f6f5 for instance 77980831-3790-419c-be64-5c42d888ff49 on hv-cinder-85944 Oct 04 08:52:50.241263 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-59da3b4f-5330-49b4-8daf-a9ec590f5ef2 req-1bb94f0c-917d-4920-9f95-316fb126a223 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040483 Oct 04 08:52:50.242292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 58/107] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:50.248225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:50.248942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:50.255682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.256280 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.256839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.262975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.263449 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.264034 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.401913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.416064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d0c989a2-43e9-483e-a1f3-a17a1e0a2b18 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.258757 Oct 04 08:52:50.424838 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 50/108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:50 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:50.455196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.468454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ffbf5d3a-b66e-4102-92bb-c68918d2bd2e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1314 microversion: 2.1 time: 0.224980 Oct 04 08:52:50.469036 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 59/109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:50 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:50.516804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:50.517435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:50.523594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.524253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.524846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.525693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.526324 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.526973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.690058 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:50.690768 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:50.699799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.702027 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.702547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.702988 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.703798 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:50.704259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:50.704859 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:50.713492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-90e293da-0c22-4696-9f48-a1d256b9c8b3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.200501 Oct 04 08:52:50.714604 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 51/110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:50 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:50.915047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.924112 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.926536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:50.928840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bf2e7413-fbe4-44d6-ac84-167c0161aad5 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.243357 Oct 04 08:52:50.930025 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 60/111] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:50 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:51.480225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:51.480225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:51.480225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.480225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.481051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.481051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.481051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.481051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.495502 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:51.496314 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:51.502552 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.503123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.503620 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.504366 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.504879 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.505622 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.649396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:51.657050 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2a9601ae-4ce7-4ec4-addc-754f183585b0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.215793 Oct 04 08:52:51.657622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 52/112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:51 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:51.684328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:51.692215 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-714147f0-ca3c-455e-b66c-cac183f3fca0 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1501 microversion: 2.1 time: 0.201054 Oct 04 08:52:51.692794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 61/113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:51 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1501 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:51.737421 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:51.738037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:51.745186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.745672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.746103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.746834 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.747287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.747735 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.889440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:51.897253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7b720d92-385e-4e95-8539-050b08e40087 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.163997 Oct 04 08:52:51.897817 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 53/114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:51 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:51.955172 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:51.955780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:51.961893 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.962372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.962838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:51.963712 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:51.964073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:51.964494 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.103987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:52.112560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:52.114278 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:52.115608 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d2e71227-ff51-4685-9b7a-d1ca37f31ff2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1406 microversion: 2.20 time: 0.164347 Oct 04 08:52:52.116174 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 62/115] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:51 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:52.273507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-68b6b1c2-e9fe-4b21-af10-129a6178a7f4 req-31c478d3-bd83-4887-b1df-163f78cee1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a71a25f-8f53-4c71-8f61-9687de80f727", "name": "network-vif-plugged", "status": "completed", "tag": "6b040ace-0eaf-4833-81ba-09cdfc978084"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:52.298653 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-68b6b1c2-e9fe-4b21-af10-129a6178a7f4 req-31c478d3-bd83-4887-b1df-163f78cee1c4 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.299142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-68b6b1c2-e9fe-4b21-af10-129a6178a7f4 req-31c478d3-bd83-4887-b1df-163f78cee1c4 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.299581 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-68b6b1c2-e9fe-4b21-af10-129a6178a7f4 req-31c478d3-bd83-4887-b1df-163f78cee1c4 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.319958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-68b6b1c2-e9fe-4b21-af10-129a6178a7f4 req-31c478d3-bd83-4887-b1df-163f78cee1c4 service nova] Creating event network-vif-plugged:6b040ace-0eaf-4833-81ba-09cdfc978084 for instance 1a71a25f-8f53-4c71-8f61-9687de80f727 on hv-cinder-85944 Oct 04 08:52:52.326826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-68b6b1c2-e9fe-4b21-af10-129a6178a7f4 req-31c478d3-bd83-4887-b1df-163f78cee1c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072227 Oct 04 08:52:52.327975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 54/116] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:52.685405 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:52.685405 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:52.689579 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.690127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.690591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.691379 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.691897 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.692434 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.714667 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:52.859315 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:52.872849 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7aa64d82-d485-4a2a-8365-a44a45a2409c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1321 microversion: 2.1 time: 0.195053 Oct 04 08:52:52.888361 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 63/117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:52 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:52.921777 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:52.923238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:52.930257 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.930783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.931334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:52.932130 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:52.932584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:52.933010 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.137569 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:53.144419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:53.145070 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:53.146107 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-16c59bf1-4ed4-4ce5-896c-92b20a9408cf tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.229228 Oct 04 08:52:53.146699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 55/118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:52 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:53.158764 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.159336 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.159869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.161259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.161924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.162580 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.330718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:53.342674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:53.344129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:53.345939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-20a49781-295a-4508-9752-975c0273ac20 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1597 microversion: 2.20 time: 0.205462 Oct 04 08:52:53.359225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 64/119] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:52:53 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1597 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:52:53.377679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:53.380916 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:53.385854 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.386557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.387070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.388460 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.388460 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.388774 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.527459 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2ebce25b-52b0-4854-8b8d-64716cf46f68 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151758 Oct 04 08:52:53.527459 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 56/120] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 4 08:52:53 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:52:53.910891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:53.911813 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:53.918391 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.919028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.919557 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:53.920319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:53.920979 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:53.921493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.129726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f37430db-8be8-42e7-81fa-e7b6dd105428"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:54.133448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:54.143679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:54.144232 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:54.145080 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.145409 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:54.145938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:54.146309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.223217 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:54.233927 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-747d842a-e994-4d51-9f95-a8b30a6badb6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1516 microversion: 2.1 time: 0.326951 Oct 04 08:52:54.235118 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 65/121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:53 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1516 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:54.256378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:54.256985 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:54.263402 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:54.263906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:54.264340 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.265227 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:54.265677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:54.266097 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.562149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:54.571363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3aeb41c4-55da-4017-bf14-de9ce5bc6f31 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.319782 Oct 04 08:52:54.572056 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 66/122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:54 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:54.576892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:54.579196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:54.586621 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:54.587114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:54.587737 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.588473 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:54.588916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:54.589343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:54.655975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lazy-loading 'flavor' on Instance uuid 77980831-3790-419c-be64-5c42d888ff49 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:52:54.985888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-81242e96-19f5-45f1-a6a9-b2cc86aadca5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49/action" status: 200 len: 32 microversion: 2.1 time: 0.412608 Oct 04 08:52:54.987388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 67/123] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:52:54 2022] POST /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49/action => generated 32 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:52:54.998891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:54.999589 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:55.006477 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:55.007128 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:55.007570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:55.008278 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:55.008733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:55.009827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:55.366826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:55.379060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-cf979780-91e2-4a0d-823f-deda7ce3ca00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.381955 Oct 04 08:52:55.380071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 68/124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:54 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:55.390718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-6604ba1c-7462-46e7-8e30-f346a35f8cf4 req-9c6860d8-e4e2-4bb7-b800-2fde5a3642f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acaf703d-ba5c-4518-a5d9-afa1a34dcfd1", "tag": "e0969193-60ee-4fb7-ba1b-70b50bfb9b9d"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:52:55.407247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-6604ba1c-7462-46e7-8e30-f346a35f8cf4 req-9c6860d8-e4e2-4bb7-b800-2fde5a3642f5 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:55.412013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-6604ba1c-7462-46e7-8e30-f346a35f8cf4 req-9c6860d8-e4e2-4bb7-b800-2fde5a3642f5 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:55.412657 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-6604ba1c-7462-46e7-8e30-f346a35f8cf4 req-9c6860d8-e4e2-4bb7-b800-2fde5a3642f5 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:55.428634 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-6604ba1c-7462-46e7-8e30-f346a35f8cf4 req-9c6860d8-e4e2-4bb7-b800-2fde5a3642f5 service nova] Creating event network-changed:e0969193-60ee-4fb7-ba1b-70b50bfb9b9d for instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 on hv-cinder-85944 Oct 04 08:52:55.435817 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-6604ba1c-7462-46e7-8e30-f346a35f8cf4 req-9c6860d8-e4e2-4bb7-b800-2fde5a3642f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054145 Oct 04 08:52:55.436442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 69/125] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:52:55.594595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:55.595288 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:55.601605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:55.602349 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:55.603097 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:55.603920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:55.604518 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:55.605018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:55.740514 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:55.750426 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a047dc3b-eb66-4845-a05c-fe3fa69d988f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.159989 Oct 04 08:52:55.751026 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 70/126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:55 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:56.404069 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:56.405452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:56.412256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.412913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.414343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.414542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.417392 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.418212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.587112 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:56.596274 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bfe27f0b-eb9e-47f5-ba52-37c063a276f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.197615 Oct 04 08:52:56.597247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 71/127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:56 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:56.780853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:56.781569 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:56.787668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.788358 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.788997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.789688 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:56.790135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:56.790621 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:56.939025 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:56.950193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f6b7d9db-f224-4c98-84d7-b115cf5c7ad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.172857 Oct 04 08:52:56.951032 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 72/128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:56 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:57.620673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:57.621327 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:57.627346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:57.633242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:57.633242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:57.633242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:57.633242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:57.633625 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:57.825783 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:57.834954 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-da271668-89af-48d3-a135-10e6398ad201 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.218564 Oct 04 08:52:57.837707 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 73/129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:57 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:57.973080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:57.973804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:57.980541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:57.981268 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:57.981702 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:57.982420 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:57.982869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:57.983452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:58.152351 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:58.160117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c3b7d442-9925-4f88-af98-df53d8d70cee tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.190828 Oct 04 08:52:58.160680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 74/130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:57 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:52:58.487768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7710bf35-dc4a-4b01-a635-20912d727c2a tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "POST /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.362701 Oct 04 08:52:58.488434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 57/131] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:52:54 2022] POST /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb/os-volume_attachments => generated 194 bytes in 4364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:52:58.860085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:58.860751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:58.866901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:58.867514 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:58.867956 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:58.869324 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:58.869823 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:58.870305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:59.009825 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:59.017679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d59a97b3-de6a-4694-a7f9-4614f135b248 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.161468 Oct 04 08:52:59.018305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 75/132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:58 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:52:59.185399 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:52:59.186010 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:52:59.192162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:59.192645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:59.193081 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:59.193766 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:52:59.194216 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:52:59.194665 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:52:59.328169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:52:59.335948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8469ab03-e060-4ec7-bd22-198023b11927 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.155936 Oct 04 08:52:59.336564 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 58/133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:52:59 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:00.040558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:00.041256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:00.047389 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:00.047874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:00.048310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:00.048994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:00.049453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:00.049883 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:00.176648 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:00.184781 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3b5c855f-3081-4291-b103-7c7565fef6c7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.148064 Oct 04 08:53:00.185347 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 76/134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:00 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:00.360245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:00.360869 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:00.367561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:00.368038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:00.369335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:00.370024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:00.370506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:00.370927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:00.502826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:00.511183 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-583426fa-bf08-430c-b2e1-35734735980a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.155022 Oct 04 08:53:00.511930 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 59/135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:00 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:01.207125 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:01.207762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:01.214843 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.215342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.215780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.216498 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.216957 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.217404 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.352508 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:01.361591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-70f099b1-6af4-4646-99c1-90c81c0f0712 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.158436 Oct 04 08:53:01.363020 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 77/136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:01 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:01.534737 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:01.536383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:01.544917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.545697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.546229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.546856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:01.547312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:01.547734 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:01.681379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:01.689182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-211e353c-8458-43fb-a9f5-839eec4ca432 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.159260 Oct 04 08:53:01.689745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 60/137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:01 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:02.386271 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:02.387501 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:02.394378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:02.395304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:02.395968 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:02.396783 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:02.397521 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:02.397952 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:02.546461 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:02.550201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:02.555580 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-015f181d-1d19-44ec-be3a-89628238f601 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.173665 Oct 04 08:53:02.556429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 78/138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:02 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:02.714008 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:02.714830 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:02.721365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:02.721855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:02.722264 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:02.722971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:02.723420 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:02.723837 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:02.743011 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:02.854375 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:02.862178 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b536d069-7f6e-4665-bfc0-e7c292a25591 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1367 microversion: 2.1 time: 0.152926 Oct 04 08:53:02.862813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 61/139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:02 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:03.581390 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:03.582028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:03.584195 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=97 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:03.589293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:03.589827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:03.590288 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:03.591004 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:03.591450 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:03.591868 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:03.753912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:03.764591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8a2043af-1937-4cd8-822b-3e35dc2f33a4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.186985 Oct 04 08:53:03.765227 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 79/140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:03 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:03.888521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:03.889929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:03.897315 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:03.897788 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:03.898216 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:03.900264 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:03.901176 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:03.901612 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:04.037759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:04.046516 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e92046d4-8f87-473a-a74c-510fa8749d0f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1558 microversion: 2.1 time: 0.162646 Oct 04 08:53:04.047319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 62/141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:03 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:04.069334 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:04.069827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:04.076199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:04.076684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:04.077118 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:04.077839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:04.078287 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:04.078777 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:04.163075 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ac045914-986b-40f0-94c7-a5c6c32b5a71 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097556 Oct 04 08:53:04.163672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 80/142] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 4 08:53:04 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:04.798218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:04.800229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:04.803773 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=77 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:04.829361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:04.830085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:04.832392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:04.833879 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:04.834753 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:04.836053 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:05.022839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:05.031018 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b6cfa75f-056d-404d-9480-4c4f82111ae6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.245678 Oct 04 08:53:05.031603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 63/143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:04 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:05.779952 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-9c498ca9-1174-4fa4-bfbe-fb1baf2a4b72 req-65d5af1f-d911-466f-8fec-cb8cd5830da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a71a25f-8f53-4c71-8f61-9687de80f727", "tag": "6b040ace-0eaf-4833-81ba-09cdfc978084"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:05.790202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9c498ca9-1174-4fa4-bfbe-fb1baf2a4b72 req-65d5af1f-d911-466f-8fec-cb8cd5830da3 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:05.790977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9c498ca9-1174-4fa4-bfbe-fb1baf2a4b72 req-65d5af1f-d911-466f-8fec-cb8cd5830da3 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:05.791403 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9c498ca9-1174-4fa4-bfbe-fb1baf2a4b72 req-65d5af1f-d911-466f-8fec-cb8cd5830da3 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:05.802852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-9c498ca9-1174-4fa4-bfbe-fb1baf2a4b72 req-65d5af1f-d911-466f-8fec-cb8cd5830da3 service nova] Creating event network-changed:6b040ace-0eaf-4833-81ba-09cdfc978084 for instance 1a71a25f-8f53-4c71-8f61-9687de80f727 on hv-cinder-85944 Oct 04 08:53:05.808304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-9c498ca9-1174-4fa4-bfbe-fb1baf2a4b72 req-65d5af1f-d911-466f-8fec-cb8cd5830da3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032241 Oct 04 08:53:05.809003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 81/144] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:06.060904 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:06.062754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:06.074422 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:06.075383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:06.076081 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:06.077058 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:06.083737 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:06.084693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:06.253551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:06.262549 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8c138ec6-d13e-4e7a-8a8f-9b9c742f572b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.208833 Oct 04 08:53:06.263504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 64/145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:06 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:07.292341 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:07.293050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:07.299883 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.300431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.300876 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.301574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:07.302027 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:07.302496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:07.440183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:07.450357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-df1b9532-5880-4ac5-99d3-eff2c84e293f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.161010 Oct 04 08:53:07.450357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 82/146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:07 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:08.474972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:08.475582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:08.482866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:08.483342 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:08.483799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:08.484483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:08.484957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:08.485381 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:08.611477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:08.619170 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8282a540-b099-4f45-bd0b-5ea8f3fe5d59 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.147977 Oct 04 08:53:08.619732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 65/147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:08 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:09.641490 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:09.642040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:09.648165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.648585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.649014 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.649760 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:09.650226 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:09.650677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:09.775754 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:09.783316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-fdc4e955-3846-4f0c-9e24-dbb1579ca26a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.145765 Oct 04 08:53:09.783847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 83/148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:09 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:10.805658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:10.806284 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:10.812979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:10.813471 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:10.813907 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.814644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:10.815098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:10.815525 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:10.953932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:10.961699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-65f26515-906d-4608-9c59-080c87639238 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.159930 Oct 04 08:53:10.963000 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 66/149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:10 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:11.988226 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:11.988226 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:11.994442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.994958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.995433 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:11.996213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:11.996668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:11.997093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.131984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:12.140205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8a564642-963e-4d2e-8d80-00de28f755ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.157142 Oct 04 08:53:12.140910 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 84/150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:11 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:12.832527 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:12.837186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:12.853962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:12.853962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:12.853962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.853962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:12.854251 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:12.854251 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:12.889557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:53:13.163581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:13.164221 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:13.172179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.172670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.173106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.173900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.174311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.174769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.214498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7814fd2b-2a41-4e0a-8fdd-6ec8dcfa0492 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 204 len: 0 microversion: 2.1 time: 0.385875 Oct 04 08:53:13.215300 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 67/151] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:12 2022] DELETE /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:53:13.223926 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:13.224540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:13.231867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.233484 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.233484 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.233484 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:13.233997 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:13.234444 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:13.366664 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:13.386322 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a0b21414-c421-43dd-9086-006b86475b7a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.226491 Oct 04 08:53:13.387463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 85/152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:13 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:13.416633 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:13.425083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-268c4e8e-b39e-4dd6-ad60-48924cb11671 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1553 microversion: 2.1 time: 0.205449 Oct 04 08:53:13.425742 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 68/153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:13 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:14.409624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:14.410236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:14.416267 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.417186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.417869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.418322 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.418782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.450012 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:14.450668 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:14.457165 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.457693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.458134 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.458855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:14.459311 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:14.459737 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:14.600499 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:14.609447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-af99fa93-2082-4a93-9b77-b173fb4139c2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.203546 Oct 04 08:53:14.610091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 86/154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:14 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:14.637495 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:14.646367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-073cca5b-d06c-4059-bb24-b2e1b2f7c2d6 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1553 microversion: 2.1 time: 0.200999 Oct 04 08:53:14.646894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 69/155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:14 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:15.635447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:15.636162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:15.643296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.644058 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.644681 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.645520 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.645902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.646752 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.670051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:15.671214 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:15.678254 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.679732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.684524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.684524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:15.684524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:15.684524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:15.848866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:15.859398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a90b7526-a650-44eb-b51f-1d125fd418b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.230505 Oct 04 08:53:15.861593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 87/156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:15 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:15.878658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:15.890682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5e584413-b015-48ad-800f-41c17125b8fb tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1553 microversion: 2.1 time: 0.224126 Oct 04 08:53:15.891392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 70/157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:15 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:16.615034 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-119eb328-2f35-4cbf-a3dc-83c4ac45bdf8 req-abb67642-03dc-4205-ac60-620cc61f0593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb", "name": "network-vif-deleted", "tag": "463f6f66-9c4c-42ef-b207-c2df5e8523b5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:16.628928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-119eb328-2f35-4cbf-a3dc-83c4ac45bdf8 req-abb67642-03dc-4205-ac60-620cc61f0593 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.629420 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-119eb328-2f35-4cbf-a3dc-83c4ac45bdf8 req-abb67642-03dc-4205-ac60-620cc61f0593 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.629966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-119eb328-2f35-4cbf-a3dc-83c4ac45bdf8 req-abb67642-03dc-4205-ac60-620cc61f0593 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.643169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-119eb328-2f35-4cbf-a3dc-83c4ac45bdf8 req-abb67642-03dc-4205-ac60-620cc61f0593 service nova] Creating event network-vif-deleted:463f6f66-9c4c-42ef-b207-c2df5e8523b5 for instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb on hv-cinder-85944 Oct 04 08:53:16.648496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-119eb328-2f35-4cbf-a3dc-83c4ac45bdf8 req-abb67642-03dc-4205-ac60-620cc61f0593 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038376 Oct 04 08:53:16.649793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 88/158] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:16.885663 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:16.886572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:16.893542 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.894147 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.894653 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.895360 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.895824 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.896275 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.920023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:16.921715 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:16.927945 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.928477 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.928915 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:16.929792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:16.930242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:16.931657 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:17.017503 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:17.022202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8b50a021-0de0-438b-a314-cc7eccecfe74 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1345 microversion: 2.1 time: 0.107939 Oct 04 08:53:17.023001 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 89/159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:16 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:17.081173 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:17.093317 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5ccee781-7bdb-4d25-807d-228969ff5441 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.210061 Oct 04 08:53:17.093317 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 71/160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:16 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:18.045880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:18.046676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:18.053012 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.053748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.054316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.056152 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.056351 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.057116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.102975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.103768 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.104385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.106105 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lazy-loading 'fault' on Instance uuid 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:18.117650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:18.120178 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:18.130816 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.141746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.141746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.141746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:18.141746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:18.142174 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:18.181242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dcf55e151b94d379bcf21073f574af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084b278155af4b28819357bcf190522d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:18.192832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1af6881c-db9c-488b-9ebb-a888e9f8a647 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 200 len: 1350 microversion: 2.1 time: 0.150965 Oct 04 08:53:18.193931 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 90/161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:18 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:18.367595 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:18.376321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-191b2b09-f996-46b5-a6d1-c3d9205f74c4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.263692 Oct 04 08:53:18.377439 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 72/162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:18 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:19.222014 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:19.222858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:19.229554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.230026 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.230484 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.231162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.231610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.232023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.246716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] HTTP exception thrown: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Request method failure captured: Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb HTTP/1.1 Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q6ghA6SWzIu-PmAnrXdRKH0pMwp0w5OeHsSc2BoOuPJF938VW_tCoBWxJisNBVmBrKwmg1jQXUAvm-HfPDFZkm5PXcUva-MzWTgQKnEDstaC1k7BUang7Z5cuAomJYU2SsauNmia2MAQWaRYSMu8RPqLxQCYx6olYstWhSsjty5AQ Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 084b278155af4b28819357bcf190522d Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:53:19.251321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/084b278155af4b28819357bcf190522d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/084b278155af4b28819357bcf190522d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_084b278155af4b28819357bcf190522d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/084b278155af4b28819357bcf190522d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 084b278155af4b28819357bcf190522d Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-DeleteServersTestJSON-1054854163-project Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 1dcf55e151b94d379bcf21073f574af5 Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-DeleteServersTestJSON-1054854163-project Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.254225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb'} Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:19.255299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.256884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.258048 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Returning 404 to user: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:19.258048 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-90328114-6037-499c-9156-1c994d41a2b8 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 404 len: 111 microversion: 2.1 time: 0.034485 Oct 04 08:53:19.258048 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 91/163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:19 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:19.382522 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:19.386184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:19.393504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.393504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.393739 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.394399 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.395047 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.395636 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.402107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:19.405226 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:19.409499 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] HTTP exception thrown: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.412322 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.413046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.413702 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Request method failure captured: Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb/os-volume_attachments HTTP/1.1 Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q6ghA6SWzIu-PmAnrXdRKH0pMwp0w5OeHsSc2BoOuPJF938VW_tCoBWxJisNBVmBrKwmg1jQXUAvm-HfPDFZkm5PXcUva-MzWTgQKnEDstaC1k7BUang7Z5cuAomJYU2SsauNmia2MAQWaRYSMu8RPqLxQCYx6olYstWhSsjty5AQ Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 084b278155af4b28819357bcf190522d Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:53:19.413822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/084b278155af4b28819357bcf190522d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/084b278155af4b28819357bcf190522d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_084b278155af4b28819357bcf190522d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/084b278155af4b28819357bcf190522d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 084b278155af4b28819357bcf190522d Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-DeleteServersTestJSON-1054854163-project Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 1dcf55e151b94d379bcf21073f574af5 Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-DeleteServersTestJSON-1054854163-project Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.415760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'server_id': '33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb'} Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:19.416752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:19.417955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:19.419044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Returning 404 to user: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:19.419044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4f1e12ae-395c-49b3-9842-d74430c884f2 tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037644 Oct 04 08:53:19.419044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 73/164] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:53:19 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:19.420291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:19.420958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:19.421593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:19.641920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:19.650071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8402e41c-240c-4090-a8c8-61e121a3fe1e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.252704 Oct 04 08:53:19.650665 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 92/165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:19 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:20.675280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:20.675896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:20.683237 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.683805 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.684309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.685105 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.685718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.686207 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.839973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:20.852539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d19c9e2e-854a-44f6-b8a2-d8f758f69713 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.180594 Oct 04 08:53:20.853274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 74/166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:20 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:20.904911 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:20.905659 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:20.911615 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.912091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.912517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.913281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.913746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.914165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] HTTP exception thrown: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Request method failure captured: Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb HTTP/1.1 Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q6ghA6SWzIu-PmAnrXdRKH0pMwp0w5OeHsSc2BoOuPJF938VW_tCoBWxJisNBVmBrKwmg1jQXUAvm-HfPDFZkm5PXcUva-MzWTgQKnEDstaC1k7BUang7Z5cuAomJYU2SsauNmia2MAQWaRYSMu8RPqLxQCYx6olYstWhSsjty5AQ Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 084b278155af4b28819357bcf190522d Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:53:20.932565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/084b278155af4b28819357bcf190522d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/084b278155af4b28819357bcf190522d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_084b278155af4b28819357bcf190522d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/084b278155af4b28819357bcf190522d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 084b278155af4b28819357bcf190522d Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-DeleteServersTestJSON-1054854163-project Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 1dcf55e151b94d379bcf21073f574af5 Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-DeleteServersTestJSON-1054854163-project Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.934046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb'} Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:20.934713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.935700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.936749 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Returning 404 to user: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:20.936749 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a24138fd-051a-4eeb-999a-3bdbf3d7af0e tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 404 len: 111 microversion: 2.1 time: 0.030345 Oct 04 08:53:20.936749 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 93/167] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:20 2022] DELETE /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:20.940114 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:20.940718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] [instance: 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:20.947507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.947981 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.948409 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.949117 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:20.949563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:20.950103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:20.963528 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] HTTP exception thrown: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Request method failure captured: Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb HTTP/1.1 Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q6ghA6SWzIu-PmAnrXdRKH0pMwp0w5OeHsSc2BoOuPJF938VW_tCoBWxJisNBVmBrKwmg1jQXUAvm-HfPDFZkm5PXcUva-MzWTgQKnEDstaC1k7BUang7Z5cuAomJYU2SsauNmia2MAQWaRYSMu8RPqLxQCYx6olYstWhSsjty5AQ Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 084b278155af4b28819357bcf190522d Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:53:20.965691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/084b278155af4b28819357bcf190522d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/084b278155af4b28819357bcf190522d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_084b278155af4b28819357bcf190522d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/084b278155af4b28819357bcf190522d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 084b278155af4b28819357bcf190522d Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-DeleteServersTestJSON-1054854163 Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-DeleteServersTestJSON-1054854163-project Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 1dcf55e151b94d379bcf21073f574af5 Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-DeleteServersTestJSON-1054854163-project Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.967205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb'} Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:20.968142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. Oct 04 08:53:20.969344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:53:20.970347 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] Returning 404 to user: Instance 33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:20.970347 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fac18b17-4b24-4499-97c1-5847860f4eca tempest-DeleteServersTestJSON-1054854163 tempest-DeleteServersTestJSON-1054854163-project] 10.222.0.27 "GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb" status: 404 len: 111 microversion: 2.1 time: 0.030940 Oct 04 08:53:20.970347 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 75/168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:20 2022] GET /compute/v2.1/servers/33c1d6f3-496b-4a3d-bdc7-184f0a8a97cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:21.889258 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:21.891036 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:21.908995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.909568 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.915256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.917495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:21.921443 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:21.921981 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:21.959352 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-291657437", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:22.060329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.network.neutron [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] validate_networks() for None {{(pid=127549) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:53:22.151537 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:22.159760 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d871d21e-6542-46df-b423-d8c29896a223 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.283922 Oct 04 08:53:22.160322 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 94/169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:21 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:22.407033 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Flavor limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:53:22.407539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Image limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:53:22.408088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Flavor pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:53:22.408483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Image pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:53:22.409069 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:53:22.422531 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.423257 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.423850 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.426612 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:22.427241 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:22.427687 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:22.451421 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Getting quotas for project 242e1450de5b4b7b9cc030474995f021. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:53:22.460458 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Getting quotas for user c6082edc5c234fd1848b58b431c7cf4b and project 242e1450de5b4b7b9cc030474995f021. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:53:22.472303 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Going to run 1 instances... {{(pid=127549) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:53:22.474765 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:53:22.871351 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cc1bd725-fcb1-49fd-ba54-e3756192b928 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921726 Oct 04 08:53:22.884531 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-fd8dc7da-3f8e-4cd8-80ce-59d2b8cf7b8e tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:22.885455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-fd8dc7da-3f8e-4cd8-80ce-59d2b8cf7b8e tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:22.891644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 76/170] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:53:22.952082 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fd8dc7da-3f8e-4cd8-80ce-59d2b8cf7b8e tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:22.962483 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-fd8dc7da-3f8e-4cd8-80ce-59d2b8cf7b8e tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1214 microversion: 2.1 time: 0.081566 Oct 04 08:53:22.980826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 95/171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:22 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:23.190013 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:23.190671 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:23.215928 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:23.216426 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:23.216865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:23.217575 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:23.219089 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:23.222264 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:23.406713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:23.419213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-af4bcc1b-9915-4590-a925-19a093a8b479 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.238632 Oct 04 08:53:23.419984 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 77/172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:23 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:23.990977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-df03ecc7-2385-454f-9b80-21bbd43b7882 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:23.991849 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-df03ecc7-2385-454f-9b80-21bbd43b7882 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:24.110267 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-df03ecc7-2385-454f-9b80-21bbd43b7882 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:24.123079 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-df03ecc7-2385-454f-9b80-21bbd43b7882 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1214 microversion: 2.1 time: 0.139159 Oct 04 08:53:24.149702 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 96/173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:23 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:24.445330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:24.448161 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:24.473326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:24.473326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:24.473326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:24.473326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:24.473780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:24.473780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:24.501422 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:24.761914 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:24.770506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-87cf03b1-5a5e-46c2-89b2-04c1f98166b5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.330545 Oct 04 08:53:24.771384 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 78/174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:24 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:25.156707 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:25.157385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:25.172139 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.172909 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.174398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.176028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.176696 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.177800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.289835 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:25.302296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ee92b1bb-8e72-415d-81da-0166a353c00c tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1266 microversion: 2.1 time: 0.149654 Oct 04 08:53:25.307878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 97/175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:25 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:25.794736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:25.795271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:25.801836 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.802317 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.802773 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.803454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:25.803900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:25.804316 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:25.990221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:26.001388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-412728fb-e3ad-4526-8e04-d16950aad952 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.211635 Oct 04 08:53:26.001961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 79/176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:25 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:26.329213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:26.330394 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:26.337871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:26.337871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:26.338540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:26.339238 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:26.339687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:26.340105 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:26.458784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:26.472060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-766c62b9-e7de-4ca9-a55e-fca0df64274f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1274 microversion: 2.1 time: 0.146741 Oct 04 08:53:26.473004 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 98/177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:26 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:27.026774 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:27.034532 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:27.038135 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.038871 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.041293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.043017 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.043702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.044515 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.257813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:27.267113 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c48ce2e6-68d0-45af-b6ff-e9b37aa8acca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.245817 Oct 04 08:53:27.267688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 80/178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:27 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:27.505921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:27.505921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:27.517644 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.518136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.518590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.522722 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:27.523374 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:27.523873 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:27.615598 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:27.628184 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d73e24ec-efe6-4b26-bf92-ddc947657ee3 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1272 microversion: 2.1 time: 0.135997 Oct 04 08:53:27.635147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 99/179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:27 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:28.291594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:28.293258 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:28.300285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.300757 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.301189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.302134 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.302766 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.303192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.481697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:28.495171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5e1f5272-3f61-4920-87b0-a8a68e15da8d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.204296 Oct 04 08:53:28.495171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 81/180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:28 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:28.654992 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:28.655658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:28.661717 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.662423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.662885 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.664033 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:28.664536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:28.665186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:28.671468 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:28.930031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:28.939987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-54d4a9a8-9ca6-4142-9ec6-7d52b44ef955 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.291265 Oct 04 08:53:28.940882 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 100/181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:28 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:29.133500 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-63583a69-fdd4-42c6-9a31-c19b7d23986c req-df710067-b96b-474b-b7dd-f9b0ac74a901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44ebb4e-ec98-438d-8d11-cdb62a713dd4", "tag": "1b3c5b66-0ffb-481c-a26c-67c701b5d705"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:29.148392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-63583a69-fdd4-42c6-9a31-c19b7d23986c req-df710067-b96b-474b-b7dd-f9b0ac74a901 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.154631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-63583a69-fdd4-42c6-9a31-c19b7d23986c req-df710067-b96b-474b-b7dd-f9b0ac74a901 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.154631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-63583a69-fdd4-42c6-9a31-c19b7d23986c req-df710067-b96b-474b-b7dd-f9b0ac74a901 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.179709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-63583a69-fdd4-42c6-9a31-c19b7d23986c req-df710067-b96b-474b-b7dd-f9b0ac74a901 service nova] Creating event network-changed:1b3c5b66-0ffb-481c-a26c-67c701b5d705 for instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 on hv-cinder-85944 Oct 04 08:53:29.187479 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-63583a69-fdd4-42c6-9a31-c19b7d23986c req-df710067-b96b-474b-b7dd-f9b0ac74a901 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057329 Oct 04 08:53:29.188454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 82/182] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:29.516830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:29.517741 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:29.524800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.525283 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.525713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.526433 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.526887 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.527303 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.729101 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:29.741846 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e58c777d-392a-4766-b5af-a91cfbfd5de3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.228678 Oct 04 08:53:29.742988 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 101/183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:29 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:29.964349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:29.965313 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:29.971948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.972439 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.972877 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:29.973570 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:29.974037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:29.974512 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.208424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:30.220992 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-593198875", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "networks": [{"uuid": "55fbb12a-1798-478e-a82a-501e9d9942f8"}]}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:30.222063 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6b478165-b313-4714-a7ba-f29f61cf35d5 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.262032 Oct 04 08:53:30.235856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 83/184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:29 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:30.300087 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] validate_networks() for [('55fbb12a-1798-478e-a82a-501e9d9942f8', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:53:30.768013 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:30.768872 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:30.779949 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.780822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.781794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.783210 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.784218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.784925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.879757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:53:30.879757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:53:30.879757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:53:30.879757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:53:30.879757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:53:30.896399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.896995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.897568 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.899764 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:30.901111 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:30.901590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:30.931035 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Getting quotas for project b1f2fb36dae5483ebc61c88336461b18. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:53:30.942177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Getting quotas for user 2677a4d76de24a729b87a211b49b965a and project b1f2fb36dae5483ebc61c88336461b18. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:53:30.960007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:53:30.963353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:53:30.983461 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:30.991675 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-191e8055-6cf4-407b-80fc-11938b447c2b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.230131 Oct 04 08:53:30.998485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 84/185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:30 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:31.121325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4c741854-6daf-4fb3-a17b-593d33d4c2bb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904755 Oct 04 08:53:31.122431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 102/186] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:53:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:53:31.134182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7b9bb038-29dd-48d6-a730-4dbd0de17557 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:31.137852 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7b9bb038-29dd-48d6-a730-4dbd0de17557 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:31.249063 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:31.250061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:31.263486 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.264081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.264593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.265371 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:31.267141 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:31.269337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:31.299371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7b9bb038-29dd-48d6-a730-4dbd0de17557 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:31.312988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7b9bb038-29dd-48d6-a730-4dbd0de17557 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1218 microversion: 2.1 time: 0.181331 Oct 04 08:53:31.313516 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 85/187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:31 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:31.613571 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:31.621553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e933c6e7-2e77-43c2-b236-93f8db418639 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.377763 Oct 04 08:53:31.622564 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 103/188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:31 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:32.016491 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:32.017305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:32.025016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.025690 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.026672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.027150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.027628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.028304 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.275160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:32.288244 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-96fec9a3-3f41-4ac8-ad7b-a1d2ac2a3cc5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.275780 Oct 04 08:53:32.289036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 86/189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:32 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:32.337216 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0cc510b2-3773-4e9a-8224-c6dabb57ec4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:32.338423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0cc510b2-3773-4e9a-8224-c6dabb57ec4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:32.474021 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0cc510b2-3773-4e9a-8224-c6dabb57ec4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:32.482887 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0cc510b2-3773-4e9a-8224-c6dabb57ec4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1218 microversion: 2.1 time: 0.150471 Oct 04 08:53:32.483792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 104/190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:32 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:32.645813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:32.646650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:32.649808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:32.654925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.655891 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.656488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:32.657551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:32.658208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:32.658856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:33.051084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:33.060442 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0b9ccac3-5cfd-4b26-a591-756c637e2696 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.418632 Oct 04 08:53:33.063044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 87/191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:32 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:33.312469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:33.313292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:33.324252 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:33.325049 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:33.325702 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:33.326423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:33.326880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:33.327303 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:33.510285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:33.511201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:33.520544 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:33.521272 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:33.521885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:33.523419 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:33.524536 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:33.525039 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:33.536399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:33.548701 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9e82bcbe-69b7-4b47-8363-ec87cf7e59e0 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.240034 Oct 04 08:53:33.567769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 105/192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:33 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:33.603584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:33.612092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6eaa6797-558c-4241-80aa-6c27dfe98532 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1214 microversion: 2.1 time: 0.106962 Oct 04 08:53:33.613194 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 88/193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:33 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:34.085261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:34.086096 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:34.093548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:34.095418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:34.096127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:34.096720 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:34.097591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:34.098237 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:34.099591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:34.343377 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:34.351976 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8d469f93-7041-44fa-b66f-44f4dd8dd206 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.270324 Oct 04 08:53:34.353536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 106/194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:34 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:34.573460 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:34.574696 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:34.581300 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:34.582017 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:34.582672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:34.583562 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:34.584188 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:34.584867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:34.638107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:34.639821 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:34.656448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:34.659511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:34.659511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:34.659511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:34.659511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:34.659823 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:34.793929 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:34.803543 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ef2597ce-82bf-4388-8289-e12453a2bcaa tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1278 microversion: 2.1 time: 0.171193 Oct 04 08:53:34.804771 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 107/195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:34 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:34.853100 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:34.861936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-185357b8-5ed6-439c-bcbd-dfcea5fda5b1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.292052 Oct 04 08:53:34.862134 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 89/196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:34 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:35.383229 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:35.384142 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:35.395242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.396062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.396709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.402707 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.403547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.404300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.620126 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:35.628370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d378a8a2-c3e8-4591-94db-997d43355413 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.249143 Oct 04 08:53:35.629145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 108/197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:35 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:35.677533 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-a1b782b2-e180-4aea-805f-f7b8ababe2ac req-e9daa622-15b5-4108-96df-1248d31ceeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44ebb4e-ec98-438d-8d11-cdb62a713dd4", "name": "network-vif-plugged", "status": "completed", "tag": "1b3c5b66-0ffb-481c-a26c-67c701b5d705"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:35.700771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:35.705178 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-a1b782b2-e180-4aea-805f-f7b8ababe2ac req-e9daa622-15b5-4108-96df-1248d31ceeda service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.705760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-a1b782b2-e180-4aea-805f-f7b8ababe2ac req-e9daa622-15b5-4108-96df-1248d31ceeda service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.709021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-a1b782b2-e180-4aea-805f-f7b8ababe2ac req-e9daa622-15b5-4108-96df-1248d31ceeda service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.728977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-a1b782b2-e180-4aea-805f-f7b8ababe2ac req-e9daa622-15b5-4108-96df-1248d31ceeda service nova] Creating event network-vif-plugged:1b3c5b66-0ffb-481c-a26c-67c701b5d705 for instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 on hv-cinder-85944 Oct 04 08:53:35.734537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-a1b782b2-e180-4aea-805f-f7b8ababe2ac req-e9daa622-15b5-4108-96df-1248d31ceeda service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063014 Oct 04 08:53:35.736373 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 90/198] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:35.835265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:35.838180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:35.848792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.849448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.850042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.850989 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.851605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.852777 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.889994 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:35.891131 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:35.915744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.915744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.915744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:35.915744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:35.916101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:35.916101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:36.299493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:36.321343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-112802b4-4f63-4195-9e35-2f85eb826011 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.496650 Oct 04 08:53:36.322677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 109/199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:35 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:36.352970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:36.361075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-25726664-6534-4218-a3b0-f569d459a4db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.478426 Oct 04 08:53:36.361993 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 91/200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:35 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:36.653776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:36.654397 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:36.664504 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:36.667004 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:36.667637 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:36.669505 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:36.671062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:36.671688 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:36.945564 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:36.964751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-39e54bf4-4cd8-471f-a9f2-6ab8c772f73f tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.314887 Oct 04 08:53:36.965409 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 110/201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:36 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:36.967429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-333e3585-bfe6-4864-9464-6e2a0852016d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'create', calling method: .version_select at 0x7f6f1a739e50>, body: {"keypair": {"name": "tempest-keypair-386630108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbFv1hsBO1KmzhqvkhPzJuXEAFQO5Gz0Bh8vko/IScv0ftMgMTHYztXw1eRAJCLVuEwHA7xJbbUhe55lXYHU5f5QahLOGu72R3HTBMAXbFOGu1NdwBeWHcFk+Yup4WxQA=="}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:36.991070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-333e3585-bfe6-4864-9464-6e2a0852016d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Getting quotas for project bc8433b42fb74e8bbfef92acedf01259. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:53:37.001395 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-333e3585-bfe6-4864-9464-6e2a0852016d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Getting quotas for user cb93504f2605489eaf50cf10930b3e46 and project bc8433b42fb74e8bbfef92acedf01259. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:53:37.101720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-333e3585-bfe6-4864-9464-6e2a0852016d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.328468 Oct 04 08:53:37.102954 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 92/202] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:53:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:37.351112 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:37.353449 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:37.381277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.387408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:37.396932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:37.400984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.401886 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:37.403493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.404235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.409151 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.411169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:37.413922 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.414968 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:37.415879 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.416487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.416916 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:37.655889 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:37.670302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2ac70962-8511-4313-b88b-74a1353930e5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1522 microversion: 2.1 time: 0.287320 Oct 04 08:53:37.670911 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 93/203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:37 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:37.676089 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-ce3a3323-859a-4f74-ae25-7755a5f2a5bc req-8cc3bb22-3b9b-4d00-b539-9370e293609f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1", "tag": "602efdf9-2f61-45ea-b518-8b6d9821574a"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:37.678235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:37.690713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-ce3a3323-859a-4f74-ae25-7755a5f2a5bc req-8cc3bb22-3b9b-4d00-b539-9370e293609f service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:37.691443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-ce3a3323-859a-4f74-ae25-7755a5f2a5bc req-8cc3bb22-3b9b-4d00-b539-9370e293609f service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:37.692171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-ce3a3323-859a-4f74-ae25-7755a5f2a5bc req-8cc3bb22-3b9b-4d00-b539-9370e293609f service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:37.694904 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5566636f-a51e-43e5-a1c5-b6617a2a1439 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.348840 Oct 04 08:53:37.697535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 111/204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:37 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:37.704751 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-ce3a3323-859a-4f74-ae25-7755a5f2a5bc req-8cc3bb22-3b9b-4d00-b539-9370e293609f service nova] Creating event network-changed:602efdf9-2f61-45ea-b518-8b6d9821574a for instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 on hv-cinder-85944 Oct 04 08:53:37.713983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-ce3a3323-859a-4f74-ae25-7755a5f2a5bc req-8cc3bb22-3b9b-4d00-b539-9370e293609f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041538 Oct 04 08:53:37.714838 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 94/205] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:37.987474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:37.988876 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:38.027283 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:38.027786 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:38.028401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:38.029352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:38.029959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:38.030588 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:38.238549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:38.247780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e1de4482-1589-4e91-97d1-d3cf84b88d4d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.263932 Oct 04 08:53:38.248452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 112/206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:37 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:38.703973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:38.704693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:38.712021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:38.712535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:38.712957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:38.713649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:38.719023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:38.719699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:38.722489 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:38.722971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:38.726969 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:38.727441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:38.727866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:38.732106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:38.732527 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:38.733125 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.281164 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:39.286590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:39.295351 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-06bb4e2d-930c-43c6-92bf-a46b5732587e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1502 microversion: 2.1 time: 0.600642 Oct 04 08:53:39.298701 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-15eb38bc-5a04-4227-a1b0-dc6b5d2c4d61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.583290 Oct 04 08:53:39.299539 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 113/207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:38 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:39.311184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 95/208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:38 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1502 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:39.313998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:39.314698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:39.322913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:39.327488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:39.330692 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.331479 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.332145 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.332420 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.332922 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.333360 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.333605 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.334054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:39.334164 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.334517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.334626 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:39.334942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:39.618175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:39.629819 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2ea38953-34be-4280-bb4e-68b465551eca tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1516 microversion: 2.1 time: 0.312429 Oct 04 08:53:39.630424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 96/209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:39 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1516 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:39.652623 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:39.660416 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-70977df5-4f3b-4e1b-b253-3536a24f3b61 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1314 microversion: 2.1 time: 0.359727 Oct 04 08:53:39.674907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 114/210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:39 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:40.327108 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:40.328377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:40.340665 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:40.343775 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:40.344452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:40.347217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:40.349440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:40.350088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:40.685885 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:40.687775 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:40.710614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:40.711838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:40.712276 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:40.712984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:40.719015 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:40.719420 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:40.918652 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:40.941365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:40.948050 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f6e92f21-8e32-477a-88c4-b3f53652f199 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.625756 Oct 04 08:53:40.964876 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 97/211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:40 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:41.047682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:41.069512 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7d04916f-4bd1-4d8f-bf94-d276572a3735 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1464 microversion: 2.1 time: 0.387788 Oct 04 08:53:41.069704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 115/212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:40 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1464 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:41.132604 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:41.133372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:41.140990 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.141904 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.142089 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.142829 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.143310 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.143819 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.175686 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:53:41.194927 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-357126122", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b69956c0-5fe6-4691-8a59-9cfb11ce6aa0"}], "security_groups": [{"name": "tempest-securitygroup--1202920787"}], "key_name": "tempest-keypair-386630108", "user_data": "}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:41.200021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:41.336254 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] validate_networks() for [('b69956c0-5fe6-4691-8a59-9cfb11ce6aa0', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:53:41.507099 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f61c19a0-30a8-466b-8fce-c3581985ae05 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 204 len: 0 microversion: 2.1 time: 0.379413 Oct 04 08:53:41.511415 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 98/213] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:53:41 2022] DELETE /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:53:41.521709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:41.522749 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:41.531620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.532781 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.534101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.534101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.534328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.534814 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.834012 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:41.859890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-27f410e0-3d0d-419f-87e3-92f5d4064879 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1470 microversion: 2.1 time: 0.342959 Oct 04 08:53:41.860723 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 99/214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:41 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1470 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:41.866028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:41.869521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:41.876070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.880349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.880349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.880349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.880349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.881085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.881175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:53:41.881594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:53:41.881994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:53:41.882421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:53:41.882839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:53:41.894300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.894914 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.895709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.898130 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:41.899792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:41.900601 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:41.911906 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lazy-loading 'flavor' on Instance uuid 07087473-a629-4720-abc6-c514a5120511 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:41.927232 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Getting quotas for project bc8433b42fb74e8bbfef92acedf01259. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:53:41.935878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Getting quotas for user cb93504f2605489eaf50cf10930b3e46 and project bc8433b42fb74e8bbfef92acedf01259. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:53:41.950658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:53:41.953344 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:53:42.116031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7888ceac-0e1d-41a5-9657-f1a8f23af2aa tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.931041 Oct 04 08:53:42.124799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 116/215] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:53:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:53:42.148165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:42.149716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:42.167429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.167429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.167429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.167693 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.167908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.168508 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.345392 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:42.359726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-20effe39-9cc3-4d6b-8c1f-0572e2902754 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.241801 Oct 04 08:53:42.360318 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 117/216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:42 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:42.365012 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5298e209-5f67-4ae8-876a-00f4c058bfae tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:42.365780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5298e209-5f67-4ae8-876a-00f4c058bfae tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:42.438428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5298e209-5f67-4ae8-876a-00f4c058bfae tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:42.445641 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5298e209-5f67-4ae8-876a-00f4c058bfae tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1236 microversion: 2.1 time: 0.084098 Oct 04 08:53:42.446360 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 118/217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:42 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:42.475646 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0d9ee182-c923-4078-af8a-2ef9f7abd6d4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511/action" status: 200 len: 32 microversion: 2.1 time: 0.613523 Oct 04 08:53:42.476488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 100/218] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:53:41 2022] POST /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511/action => generated 32 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:53:42.488189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:42.488934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:42.496041 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.496526 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.496966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.497652 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.498104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.498561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.641173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:42.648983 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-defa6e7e-a5bd-4a74-83dd-c066c1dce550 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.165832 Oct 04 08:53:42.649540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 119/219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:42 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:42.884566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:42.885270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:42.891509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.891993 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.892428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:42.898202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:42.898202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:42.898202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.029120 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:43.037401 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-16424071-f853-484b-a6be-ffc85305065d tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1470 microversion: 2.1 time: 0.157428 Oct 04 08:53:43.037966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 101/220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:42 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:43.386359 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:43.387007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:43.393103 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.393589 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.394231 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.395187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.395939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.396053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.401079 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:43.468765 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:43.469924 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:43.476925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.477491 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.477929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.478705 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.479369 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.482955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.575129 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:43.585184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1bdf38e7-c852-4a06-bad3-01d3a0df4d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1240 microversion: 2.1 time: 0.120223 Oct 04 08:53:43.587518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 102/221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:43 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:43.600513 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:43.609300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-342554c0-c4cd-4670-bcda-6ff5399a552e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.230402 Oct 04 08:53:43.609954 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 120/222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:43 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:43.671588 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:43.672229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:43.678154 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.678668 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.679105 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.680343 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:43.681148 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:43.681268 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:43.825131 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:43.828207 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-761d1d67-d9f5-45fd-95fa-cd63cdb79383 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.160491 Oct 04 08:53:43.828767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 103/223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:43 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:44.061631 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:44.062240 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:44.068983 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.069520 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.069956 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.071191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.071648 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.072079 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.216038 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:44.224028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-47077a08-c7d4-4f04-9ddd-c1c73b7c3d87 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1470 microversion: 2.1 time: 0.166252 Oct 04 08:53:44.239045 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 121/224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:44 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:44.612862 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:44.614530 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:44.622358 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.623147 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.623572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.624430 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.624882 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.629592 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.633591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:44.634213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:44.641437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.642229 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.643524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.646440 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.648241 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.649655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.703357 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:44.718139 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7c43bf94-87bc-439c-b147-1d601549870b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1288 microversion: 2.1 time: 0.109313 Oct 04 08:53:44.743388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 104/225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:44 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1288 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:44.853485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:44.854383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:44.864885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.864885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.864885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.866104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:44.866865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:44.868558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:44.911265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:44.922752 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-fbfd6233-f3b7-48a3-b553-735f12d518e7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.293708 Oct 04 08:53:44.923903 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 122/226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:44 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:45.109846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:45.117975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-5224b8cf-91ad-4895-aad8-0d98ce993a0b req-5049bee5-204b-42a5-9e3b-c5a7f8cb653a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44ebb4e-ec98-438d-8d11-cdb62a713dd4", "name": "network-vif-deleted", "tag": "1b3c5b66-0ffb-481c-a26c-67c701b5d705"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:45.119485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b477e5c1-ca44-4c65-aece-35c70a492518 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.271934 Oct 04 08:53:45.127649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 105/227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:44 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:45.133091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5224b8cf-91ad-4895-aad8-0d98ce993a0b req-5049bee5-204b-42a5-9e3b-c5a7f8cb653a service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.133610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5224b8cf-91ad-4895-aad8-0d98ce993a0b req-5049bee5-204b-42a5-9e3b-c5a7f8cb653a service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.134026 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5224b8cf-91ad-4895-aad8-0d98ce993a0b req-5049bee5-204b-42a5-9e3b-c5a7f8cb653a service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.149076 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-5224b8cf-91ad-4895-aad8-0d98ce993a0b req-5049bee5-204b-42a5-9e3b-c5a7f8cb653a service nova] Creating event network-vif-deleted:1b3c5b66-0ffb-481c-a26c-67c701b5d705 for instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 on hv-cinder-85944 Oct 04 08:53:45.154827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-5224b8cf-91ad-4895-aad8-0d98ce993a0b req-5049bee5-204b-42a5-9e3b-c5a7f8cb653a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055274 Oct 04 08:53:45.155416 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 123/228] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:45.248375 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:45.248986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:45.256619 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.257103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.257560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.258282 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.258764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.259183 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.387990 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:45.396311 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5de2ab29-531f-4fbb-aa41-9dc6833f51d2 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1428 microversion: 2.1 time: 0.151895 Oct 04 08:53:45.396902 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 106/229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:45 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:45.529455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-34c19640-e848-4e09-b24f-a6148850aa8a req-c4c65188-e618-4381-a390-c24251a9e424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1", "name": "network-vif-plugged", "status": "completed", "tag": "602efdf9-2f61-45ea-b518-8b6d9821574a"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:45.539949 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-34c19640-e848-4e09-b24f-a6148850aa8a req-c4c65188-e618-4381-a390-c24251a9e424 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.540805 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-34c19640-e848-4e09-b24f-a6148850aa8a req-c4c65188-e618-4381-a390-c24251a9e424 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.541241 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-34c19640-e848-4e09-b24f-a6148850aa8a req-c4c65188-e618-4381-a390-c24251a9e424 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.551920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-34c19640-e848-4e09-b24f-a6148850aa8a req-c4c65188-e618-4381-a390-c24251a9e424 service nova] Creating event network-vif-plugged:602efdf9-2f61-45ea-b518-8b6d9821574a for instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 on hv-cinder-85944 Oct 04 08:53:45.557371 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-34c19640-e848-4e09-b24f-a6148850aa8a req-c4c65188-e618-4381-a390-c24251a9e424 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032442 Oct 04 08:53:45.558021 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 124/230] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:45.743211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:45.743832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:45.750571 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.751058 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.751491 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.752189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.752856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.753277 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.828859 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:45.838656 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7debddec-2e56-4333-9e23-ba360c9960d0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1296 microversion: 2.1 time: 0.099764 Oct 04 08:53:45.840135 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 107/231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:45 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:45.953632 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:45.954157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:45.974130 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.974660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.975096 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:45.975793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:45.976245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:45.976877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.153051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:46.153683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:46.160926 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.161995 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.162823 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.163758 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.165476 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.166373 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.223108 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:46.236008 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-962f4511-2ba0-4cb4-aac8-a7088deb2276 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.286228 Oct 04 08:53:46.237449 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 125/232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:45 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:46.331989 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:46.340752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a08a1457-cc60-45c5-9612-27d41da9cd7f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.193838 Oct 04 08:53:46.358063 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 108/233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:46 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:46.420736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:46.421992 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:46.432819 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.433478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.433947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.434681 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.435313 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.438057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.471057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.471654 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.472165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.472801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lazy-loading 'fault' on Instance uuid f44ebb4e-ec98-438d-8d11-cdb62a713dd4 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:46.515761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6082edc5c234fd1848b58b431c7cf4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '242e1450de5b4b7b9cc030474995f021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:46.524086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-826f54ed-f7c6-45c4-85de-586287ff7dda tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 200 len: 1304 microversion: 2.1 time: 0.107261 Oct 04 08:53:46.524832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 126/234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:46 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:46.863731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:46.864354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:46.871035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.871529 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.871970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.872678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:46.873135 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:46.873562 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:46.938361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:46.946839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b8b3947d-81c4-4672-af41-7584c93a9d38 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1306 microversion: 2.1 time: 0.086489 Oct 04 08:53:46.947746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 109/235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:46 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:47.273183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:47.274847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:47.292649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.293159 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.293595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.294305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.294787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.295209 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.366252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:47.369728 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:47.383529 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=12 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:47.385496 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.386154 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.387285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.395885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.397097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.397710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.564108 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:47.579787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f9a9ba2d-3c94-496d-939d-914ebb9a285c tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1318 microversion: 2.1 time: 0.310267 Oct 04 08:53:47.580726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 127/236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:47 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:47.593941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:47.597769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] [instance: f44ebb4e-ec98-438d-8d11-cdb62a713dd4] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:47.599819 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:47.611745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9864ddab-d3ef-4a20-8128-a4788310acc1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.249723 Oct 04 08:53:47.613004 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 110/237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:47 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:47.622667 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.623525 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.624239 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.625378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.626046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.626601 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.642739 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] HTTP exception thrown: Instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 could not be found. Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Request method failure captured: Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 HTTP/1.1 Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_R_NfqFSVz0JQimKDEpmKIhf2ii_TgWFLwWmC2ksW-2TL542wJLEt91F6qyzcs8Kbz2ZT3_Mz1qf_llroPJ8LjFM0TZ5g8e0enlRTJqil87CgsfIFKRcsjBcwsbxUKeYLJyqojI_lBih2X0JRmoeT1l4-AIe9VoG33Ce0aP6i8C3rU Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 242e1450de5b4b7b9cc030474995f021 Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesNegativeTest-1970160266 Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:53:47.644457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/242e1450de5b4b7b9cc030474995f021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/242e1450de5b4b7b9cc030474995f021"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_242e1450de5b4b7b9cc030474995f021", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/242e1450de5b4b7b9cc030474995f021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesNegativeTest-1970160266 Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 242e1450de5b4b7b9cc030474995f021 Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesNegativeTest-1970160266 Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesNegativeTest-1970160266-project Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: c6082edc5c234fd1848b58b431c7cf4b Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesNegativeTest-1970160266-project Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 could not be found. Oct 04 08:53:47.645984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'f44ebb4e-ec98-438d-8d11-cdb62a713dd4'} Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 could not be found. Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:53:47.651761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 could not be found. Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 could not be found. Oct 04 08:53:47.655395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:53:47.656423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] Returning 404 to user: Instance f44ebb4e-ec98-438d-8d11-cdb62a713dd4 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:53:47.656423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-de27c197-8673-4a33-8418-48450e00b561 tempest-VolumesNegativeTest-1970160266 tempest-VolumesNegativeTest-1970160266-project] 10.222.0.27 "GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4" status: 404 len: 111 microversion: 2.1 time: 0.063195 Oct 04 08:53:47.656423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 128/238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:47 2022] GET /compute/v2.1/servers/f44ebb4e-ec98-438d-8d11-cdb62a713dd4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:47.972575 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:47.974014 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:47.982213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.983172 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.983978 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:47.985124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:47.985765 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:47.986377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:48.174743 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:48.196552 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a58a35df-def7-46cf-9ec3-6b19e0acf227 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.228007 Oct 04 08:53:48.197049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 111/239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:47 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:48.607670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:48.608289 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:48.615655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:48.623748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:48.623748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:48.623893 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:48.624259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:48.624679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:48.639218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:48.639984 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:48.650009 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:48.650536 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:48.650978 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:48.651838 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:48.652293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:48.652716 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:48.691817 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:48.889286 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:48.901996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a6992015-fa42-4bbd-af97-1fd0c726893a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.269125 Oct 04 08:53:48.906629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:48.907181 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 112/240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:48 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:48.917294 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-70e1030b-50ea-4351-8bb1-deaee29bc786 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1508 microversion: 2.1 time: 0.313591 Oct 04 08:53:48.918460 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 129/241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:48 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:53:49.142160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-99ae3fb9-56c0-48a6-9717-6a6a40365b00 req-5d6f83cb-1186-45c6-b793-2094aaaec2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b087fca8-b245-4d5b-8cd3-1baec0ad7560", "tag": "2689379b-47a8-42fb-97fd-2b3a41375c74"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:49.153846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-99ae3fb9-56c0-48a6-9717-6a6a40365b00 req-5d6f83cb-1186-45c6-b793-2094aaaec2f4 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:49.154654 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-99ae3fb9-56c0-48a6-9717-6a6a40365b00 req-5d6f83cb-1186-45c6-b793-2094aaaec2f4 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:49.155248 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-99ae3fb9-56c0-48a6-9717-6a6a40365b00 req-5d6f83cb-1186-45c6-b793-2094aaaec2f4 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:49.169741 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-99ae3fb9-56c0-48a6-9717-6a6a40365b00 req-5d6f83cb-1186-45c6-b793-2094aaaec2f4 service nova] Creating event network-changed:2689379b-47a8-42fb-97fd-2b3a41375c74 for instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 on hv-cinder-85944 Oct 04 08:53:49.175885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-99ae3fb9-56c0-48a6-9717-6a6a40365b00 req-5d6f83cb-1186-45c6-b793-2094aaaec2f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038021 Oct 04 08:53:49.176989 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 113/242] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:53:49.226158 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:49.226998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:49.234191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:49.234605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:49.235200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:49.239502 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:49.240788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:49.241334 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:49.501605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:49.511117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0d710e0d-c085-489e-9c92-1eb21097648c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.288742 Oct 04 08:53:49.511696 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 130/243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:49 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:49.943124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:49.944066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:49.956627 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:49.960797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:49.960797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:49.960797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:49.960797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:49.961457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.140689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:50.156986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ab2e073a-4f1a-4322-a3e6-7bbac3c91458 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.218158 Oct 04 08:53:50.158984 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 114/244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:49 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:50.534878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:50.540450 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:50.551084 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:50.551624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:50.557958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.557958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:50.557958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:50.557958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.623573 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:50.624077 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:50.635893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:50.636590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:50.637544 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.639194 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:50.640680 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:50.641123 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:50.693666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-12558c30-5439-4055-a61f-4066d8294a16 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/ips" status: 200 len: 150 microversion: 2.20 time: 0.073979 Oct 04 08:53:50.696220 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 115/245] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Oct 4 08:53:50 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:53:50.738597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:50.748858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7f8d3b01-b339-4ca9-bbc7-8cb15b39fb4b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.218359 Oct 04 08:53:50.752842 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 131/246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:50 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:51.183402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:51.184721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:51.191990 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:51.192695 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:51.193295 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:51.194332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:51.195585 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:51.196039 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:51.424579 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:51.433304 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e4e551fc-a226-403c-92c6-d018b0729c46 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.255629 Oct 04 08:53:51.433901 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 116/247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:51 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:51.777382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:51.778358 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:51.792321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:51.792321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:51.792321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:51.794214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:51.795934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:51.797583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:51.914824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:52.046822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:52.056057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-099eff7e-975b-497b-a222-bda81ad8325a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.283595 Oct 04 08:53:52.068600 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 132/248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:51 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:52.456836 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:52.457503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:52.465694 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:52.466185 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:52.466733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:52.468041 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:52.473080 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:52.473080 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:52.633413 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:52.650443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0d9cc191-abc3-4c8e-9310-6fbd3de3d694 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.197361 Oct 04 08:53:52.651069 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 117/249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:52 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:53.084815 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:53.087686 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:53.096806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=20 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:53.098642 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:53.099133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:53.099571 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:53.100368 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:53.100831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:53.101301 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:53.258123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:53.276443 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-42891d13-435e-44d2-8e52-64f31a0ffe11 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.194006 Oct 04 08:53:53.277054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 133/250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:53 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:53.673505 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:53.674112 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:53.682217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:53.682723 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:53.683156 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:53.683876 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:53.684326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:53.684747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:53.825563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:53.834697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e016658a-2068-471e-aec2-a1813495d76c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.164968 Oct 04 08:53:53.835383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 118/251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:53 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:54.314146 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:54.314860 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:54.339427 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:54.339935 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:54.340383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:54.366691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:54.368235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:54.369449 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:54.594518 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:54.603844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0258358c-3249-42f2-b04b-554c3e8c47b6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.306737 Oct 04 08:53:54.629997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 134/252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:54 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:54.861475 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:54.862130 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:54.869054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:54.872890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:54.872890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:54.872890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:54.872890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:54.873269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:55.022304 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:55.030751 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a839198f-12ca-455a-ae66-b1715bc0c9d1 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.173387 Oct 04 08:53:55.031321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 119/253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:54 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:55.632658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:55.634029 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:55.645528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:55.646375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:55.647187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:55.648092 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:55.648774 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:55.649544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:55.815160 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:55.825893 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1c7bfbfd-d32d-4fd1-a58b-d4ec2ad63c28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.197646 Oct 04 08:53:55.838457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 135/254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:55 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:56.060022 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:56.065555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:56.073515 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:56.078882 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:56.079558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:56.080622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:56.081244 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:56.081844 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:56.312228 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:56.322832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b559e6a7-4c95-4463-85d9-3d19574f7130 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.269526 Oct 04 08:53:56.323929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 120/255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:56 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:56.853814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:56.855005 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:56.866935 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:56.868135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:56.868854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:56.869681 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:56.870182 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:56.870733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.029224 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:57.037032 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-03f1c8dd-87c2-4aa4-8c4d-81ba804742d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.190402 Oct 04 08:53:57.037594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 136/256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:56 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:57.347945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:57.348568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:57.355868 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:57.356368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:57.356799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.357502 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:57.357948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:57.358989 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.528209 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:57.537373 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8dd29bba-a7bd-4664-adcc-74ba47a9172c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.193567 Oct 04 08:53:57.537840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 121/257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:57 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:57.852523 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:57.853218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:57.860535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:57.861822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:57.862555 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.863364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:57.864010 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:57.864758 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:57.895053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lazy-loading 'flavor' on Instance uuid acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:53:57.983075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-c3dc4117-356b-4815-8f20-06185bba6889 req-524b0d0c-c110-431a-9f1a-68c9fd068f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b087fca8-b245-4d5b-8cd3-1baec0ad7560", "name": "network-vif-plugged", "status": "completed", "tag": "2689379b-47a8-42fb-97fd-2b3a41375c74"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:53:58.004415 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:58.023937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-c3dc4117-356b-4815-8f20-06185bba6889 req-524b0d0c-c110-431a-9f1a-68c9fd068f78 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.024525 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-c3dc4117-356b-4815-8f20-06185bba6889 req-524b0d0c-c110-431a-9f1a-68c9fd068f78 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.024984 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-c3dc4117-356b-4815-8f20-06185bba6889 req-524b0d0c-c110-431a-9f1a-68c9fd068f78 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.096938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-c3dc4117-356b-4815-8f20-06185bba6889 req-524b0d0c-c110-431a-9f1a-68c9fd068f78 service nova] Creating event network-vif-plugged:2689379b-47a8-42fb-97fd-2b3a41375c74 for instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 on hv-cinder-85944 Oct 04 08:53:58.108463 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-c3dc4117-356b-4815-8f20-06185bba6889 req-524b0d0c-c110-431a-9f1a-68c9fd068f78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134230 Oct 04 08:53:58.110601 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 122/258] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:53:58.134036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:58.146146 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:58.161199 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.166371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.167294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.170254 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.172424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.173804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.479574 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:58.491885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4e0cc438-c589-4ad0-8514-6bd273128557 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.378654 Oct 04 08:53:58.493433 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 123/259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:58 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:58.581312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:58.595354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:58.613655 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.615043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.615969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.616732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.617914 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.618350 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.638846 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a6714e52-6fb7-42b0-a9bd-c601ec0908e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/action" status: 202 len: 0 microversion: 2.20 time: 0.791508 Oct 04 08:53:58.639456 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 137/260] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 4 08:53:57 2022] POST /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:53:58.649378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:58.650670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:58.663146 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.665916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.667200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.668394 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:58.669978 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:58.671825 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:58.916707 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:58.963108 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9bc244f0-0e5f-4637-9f6e-c6c96b73c9c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.377466 Oct 04 08:53:58.963363 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 124/261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:58 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:59.152368 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:59.161562 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:59.168227 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:59.169728 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ec44ae05-a3ae-463d-9a59-bb7f7f3d4de8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.525303 Oct 04 08:53:59.196061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 138/262] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:53:58 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:53:59.518010 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:59.518685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:59.526221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:59.526738 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:59.527178 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:59.527881 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:59.528336 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:53:59.528763 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:53:59.691916 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:53:59.701461 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-26a785b4-c4b4-4181-9871-1f38130f8997 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.189676 Oct 04 08:53:59.702111 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 125/263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:59 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:53:59.986985 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:53:59.987596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:53:59.997879 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:53:59.998378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:00.000576 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:00.001305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:00.001765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:00.002189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:00.156857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:00.166715 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0001a006-65db-49d0-8675-f6df990b755e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.183639 Oct 04 08:54:00.167500 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 139/264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:53:59 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:00.203045 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:00.207487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:00.225456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:00.228477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:00.229185 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:00.230750 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:00.231417 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:00.232062 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:00.470419 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:00.480812 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:00.482291 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:00.483751 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e7d53316-eaac-4345-9e2b-f6e220531721 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.285226 Oct 04 08:54:00.484320 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 126/265] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:00 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:00.726668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:00.726912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:00.740218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:00.740218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:00.740218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:00.740218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:00.740894 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:00.744189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.022791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:01.031478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7b93f280-4f80-46a5-8520-6c93c0fcb13d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1362 microversion: 2.1 time: 0.310228 Oct 04 08:54:01.032726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 140/266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:00 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:01.200818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:01.202023 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:01.223198 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.223810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.225079 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.226028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.235876 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.246179 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.280250 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:01.281709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:01.291678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.297352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.299136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.299136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.299136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.299355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.381345 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-15b4d5a8-615c-484a-ad96-302d33e19b78 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/ips" status: 200 len: 151 microversion: 2.1 time: 0.115786 Oct 04 08:54:01.399983 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 141/267] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:54:01 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/ips => generated 151 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:01.518355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:01.519471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:01.527604 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:01.531676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.534260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.534260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.540511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:01.542058 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:01.543049 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:01.545094 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-80892247-1f42-4cce-9b79-5f845ab89651 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.352163 Oct 04 08:54:01.545903 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 127/268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:01 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:01.815055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:01.834257 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:01.836936 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:01.838806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-12eac8f7-c4ab-4a77-9c93-47aec0dfb338 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.328970 Oct 04 08:54:01.839374 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 142/269] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:01 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:02.059359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:02.060043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:02.069645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.070283 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.083752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.093875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.093875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.093875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.292893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:02.302268 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-96b21b4c-da52-416b-a80b-c027e566c45f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1548 microversion: 2.1 time: 0.247733 Oct 04 08:54:02.302879 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 128/270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:02 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1548 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:02.331696 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:02.332228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:02.339306 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.348596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.348596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.348596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.348596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.348960 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.571222 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:02.572065 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:02.600574 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.603899 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.609923 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.610839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.614520 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.615724 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.835165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-63d58fe4-3d2c-4355-b82d-50dfbfb93b42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.508171 Oct 04 08:54:02.836848 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 143/271] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 4 08:54:02 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/os-interface => generated 284 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:02.874300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:02.875021 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:02.890821 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.891320 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.891751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.892454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:02.892905 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:02.893318 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:02.919802 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:02.929016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-44ec6755-7ecf-4693-bbe7-b46f4a939d4c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.363372 Oct 04 08:54:02.930177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 129/272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:02 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:03.114683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:03.125150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:03.127044 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:03.128428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0b0546ce-2df6-45da-977e-da502720e7c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.258285 Oct 04 08:54:03.129133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 144/273] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:02 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:03.958205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:03.972368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:03.989899 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:03.994051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:03.994771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:03.995826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:03.996477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:03.997097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.026302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:04.155750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:04.157003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:04.171017 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.171776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.172375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.173246 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.173854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.174443 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.295088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:04.307955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-46a5c835-1c38-4333-aa62-720a4aff1cee tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.353985 Oct 04 08:54:04.309201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 130/274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:03 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:04.472242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:04.481877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:04.484180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:04.485539 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-30ddf44f-6d30-4139-a95d-48311bfdcf5b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.333936 Oct 04 08:54:04.499661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 145/275] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:04 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:04.541473 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-449ca43a-a7fd-446a-934d-8a2dd8b1f246 req-1f606cbc-58b5-4a41-933f-b3a582df9a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b087fca8-b245-4d5b-8cd3-1baec0ad7560", "tag": "2689379b-47a8-42fb-97fd-2b3a41375c74"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:04.551839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-449ca43a-a7fd-446a-934d-8a2dd8b1f246 req-1f606cbc-58b5-4a41-933f-b3a582df9a40 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:04.554960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-449ca43a-a7fd-446a-934d-8a2dd8b1f246 req-1f606cbc-58b5-4a41-933f-b3a582df9a40 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:04.555501 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-449ca43a-a7fd-446a-934d-8a2dd8b1f246 req-1f606cbc-58b5-4a41-933f-b3a582df9a40 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:04.574354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-449ca43a-a7fd-446a-934d-8a2dd8b1f246 req-1f606cbc-58b5-4a41-933f-b3a582df9a40 service nova] Creating event network-changed:2689379b-47a8-42fb-97fd-2b3a41375c74 for instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 on hv-cinder-85944 Oct 04 08:54:04.580417 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-449ca43a-a7fd-446a-934d-8a2dd8b1f246 req-1f606cbc-58b5-4a41-933f-b3a582df9a40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044558 Oct 04 08:54:04.586282 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 131/276] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:05.332441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:05.340822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:05.340822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:05.342597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:05.343704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:05.344395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:05.345479 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:05.346190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:05.349140 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:05.513991 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:05.515532 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:05.525348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:05.545900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:05.551541 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:05.551541 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:05.555313 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:05.556277 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:05.561007 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:05.587591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:05.596832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ad93eef8-9eab-4766-bf1c-f815a012cffe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.268177 Oct 04 08:54:05.597418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 146/277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:05 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:05.822144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:05.835464 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:05.837310 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:05.838722 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-36eb5b40-8f74-4372-8c3d-78c43467d3da tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.329234 Oct 04 08:54:05.862644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 132/278] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:05 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:06.058700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1761e0ed-2f94-44e8-974c-3e6fe4be37c0"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:06.061154 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:06.080874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:06.084091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:06.084091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:06.084091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:06.084091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:06.084495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:06.623852 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:06.633313 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:06.635806 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:06.639263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:06.651160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:06.652296 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:06.652839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:06.653340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:07.034537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:07.056778 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7360f672-cc02-48d0-b3bb-d58b49dfa9f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.436581 Oct 04 08:54:07.057857 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 133/279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:06 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:07.069266 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:07.081999 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:07.105425 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:07.106080 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:07.107331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:07.108306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:07.109191 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:07.110137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:07.274958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:07.284233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:07.298568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:07.298568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-38719ca0-e0e7-4e0d-968d-5e589b1a353f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.227070 Oct 04 08:54:07.298568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 134/280] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:07 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:08.082028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:08.087938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:08.092693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:08.093382 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:08.093821 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:08.094670 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:08.095127 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:08.095763 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:08.245594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:08.253401 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-108b6af0-4601-41c3-9478-c24f0bd20cc3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.175185 Oct 04 08:54:08.266128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 135/281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:08 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:08.317514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:08.318496 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:08.325077 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:08.325568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:08.326006 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:08.326726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:08.327181 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:08.327609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:08.490913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:08.500894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:08.502768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:08.504202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5b8d238a-6384-40ff-bca2-f2d0c7d3287f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.190545 Oct 04 08:54:08.506839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 136/282] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:08 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:09.277037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:09.277675 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:09.284201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:09.284689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:09.285630 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:09.286651 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:09.286651 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:09.295811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:09.430294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:09.438798 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-452aa4c2-0f79-4479-8a31-6d0f837f85c9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.165509 Oct 04 08:54:09.454434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 137/283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:09 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:09.537388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:09.539597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:09.545891 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:09.546958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:09.547609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:09.548555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:09.549387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:09.549907 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:09.703533 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:09.713503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:09.714983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:09.716146 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e5e93e5a-437a-4c25-9892-9497d55485c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.182913 Oct 04 08:54:09.717142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 138/284] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:09 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:10.464982 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:10.465650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:10.481897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:10.484128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:10.484128 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:10.484356 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:10.484726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:10.485356 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:10.644150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:10.653614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cae32ef9-9301-43d7-819d-bb391851f996 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.193695 Oct 04 08:54:10.670781 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 139/285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:10 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:10.742666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:10.743284 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:10.752040 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:10.752526 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:10.752962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:10.753667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:10.754125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:10.754654 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:10.899247 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:10.907635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:10.909082 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:10.910229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9e78a0c9-249d-4cb2-9d3a-4b46b7643f53 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.171589 Oct 04 08:54:10.910830 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 140/286] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:10 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:11.572251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-849773e7-8e5a-4dc4-81fe-dd4f0b903582 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.519068 Oct 04 08:54:11.572874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 147/287] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:54:06 2022] POST /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments => generated 194 bytes in 5521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:11.676560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:11.677238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:11.689457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:11.689457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:11.689457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:11.689457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:11.689785 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:11.689869 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:11.876733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:11.886955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-db90529a-4486-404f-bf99-4f8f4bc5673f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.214053 Oct 04 08:54:11.887709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 141/288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:11 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:11.940952 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:11.941763 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:11.951335 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:11.951630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:11.952078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:11.953126 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:11.953768 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:11.954207 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:12.106778 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:12.119234 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:12.121150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:12.122373 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0873f333-b8a1-47ba-8962-23206f833fb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.189981 Oct 04 08:54:12.123459 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 148/289] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:11 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:12.910987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:12.912281 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:12.927308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:12.927308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:12.927308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:12.927308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:12.929632 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:12.930366 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.126459 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:13.136795 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9253f6f9-77cd-4c95-b54d-9cc1a6e7cc00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1502 microversion: 2.1 time: 0.229851 Oct 04 08:54:13.137375 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 142/290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:12 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:13.152749 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:13.154863 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:13.161035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "627d060a-59e7-4842-a33e-a3a2d53ee5d0"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:13.165420 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:13.172780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.173859 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.174629 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.175506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.176121 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.176514 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.176715 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.177274 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.177804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.178658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.179850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.182435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.213181 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] HTTP exception thrown: Cannot 'attach_volume' instance 07087473-a629-4720-abc6-c514a5120511 while it is in vm_state rescued Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Request method failure captured: Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: POST /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511/os-volume_attachments HTTP/1.1 Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 74 Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q8nvQCICfen3pq97UBwOKAMoZuSLY4oYNU1g1pfzcE7nSRmscvW6djdCBaFthjVByDfjI7bcnzGrhG0chZkiFXoV5uEzdauqf-NQNNqVkMZE8rIvPG2Ro5fFh5MoE5uvuaSXXp6IxgVox7YnOY7DKJ-fvcK4qinIf0Ca7fW_5aQVM Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:54:13.213346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b4590edfe642bc8a8bd15a1b8ba464", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 185e359e571f44bda1585124529b36a8 Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {"volumeAttachment": {"volumeId": "627d060a-59e7-4842-a33e-a3a2d53ee5d0"}} Oct 04 08:54:13.214957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Cannot 'attach_volume' instance 07087473-a629-4720-abc6-c514a5120511 while it is in vm_state rescued Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'server_id': '07087473-a629-4720-abc6-c514a5120511', 'body': {'volumeAttachment': {'volumeId': '627d060a-59e7-4842-a33e-a3a2d53ee5d0'}}} Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07087473-a629-4720-abc6-c514a5120511 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:54:13.216024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 07087473-a629-4720-abc6-c514a5120511 while it is in vm_state rescued Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:54:13.217635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:54:13.219119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:54:13.219119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:54:13.219119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 07087473-a629-4720-abc6-c514a5120511 while it is in vm_state rescued Oct 04 08:54:13.219119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:54:13.219119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Returning 409 to user: Cannot 'attach_volume' instance 07087473-a629-4720-abc6-c514a5120511 while it is in vm_state rescued {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:54:13.219119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fe9d900e-949d-45fa-af70-f42d3740f48e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059017 Oct 04 08:54:13.219119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 143/291] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:54:13 2022] POST /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 08:54:13.224425 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:13.224970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:13.241180 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.243087 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.245785 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.246631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.247174 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.247938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.372672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:13.381879 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:13.384331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:13.385736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5f2633dc-b42c-41bf-9f29-d4646d03898c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.237524 Oct 04 08:54:13.400378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 149/292] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:13 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:13.599371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f3770f59-0277-4605-80b3-3f90afdd9bd8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511/action" status: 202 len: 0 microversion: 2.1 time: 0.378839 Oct 04 08:54:13.604021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 144/293] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:54:13 2022] POST /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:54:13.609496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:13.610106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:13.626853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.627371 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.631335 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.634980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:13.635534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:13.635991 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:13.855148 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:13.863720 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-271c365f-e791-4d07-84e0-4bdbfc32a9e9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1510 microversion: 2.1 time: 0.258335 Oct 04 08:54:13.864921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 150/294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:13 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:14.415024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:14.415768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:14.436296 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:14.436296 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:14.436296 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:14.436296 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:14.436764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:14.436764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:14.640460 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:14.653863 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:14.655720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:14.656928 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-207241d4-e551-4fb2-baa6-47f26b3ae349 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.247552 Oct 04 08:54:14.657988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 145/295] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:14 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:14.893243 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:14.893836 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:14.901069 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:14.901551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:14.901988 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:14.903005 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:14.903173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:14.903561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:15.073086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:15.080755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c0f05db3-9c01-4552-a2e8-75174cd59b92 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1510 microversion: 2.1 time: 0.191937 Oct 04 08:54:15.081317 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 151/296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:14 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:15.685689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:15.686961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:15.694674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:15.695305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:15.695980 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:15.696780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:15.697297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:15.697786 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:15.714071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b1656ad-184a-4ec4-b3ba-fcfb4a150493", "device": "/dev/sdb"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:15.717128 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:15.723625 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:15.724118 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:15.724559 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:15.725276 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:15.727040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:15.727559 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:15.744775 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:15.852066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:15.861472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:15.862996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:15.864141 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cd4b87b1-83fb-46cd-9c9d-f5ca72c3a903 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.183539 Oct 04 08:54:15.864826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 146/297] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:15 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:16.105488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:16.106137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:16.112627 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:16.113138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:16.113568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:16.114254 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:16.114729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:16.115153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:16.119904 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:16.263849 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:16.271729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-12c7ec25-75dc-4447-ad0e-16a1378aeb12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1510 microversion: 2.1 time: 0.171292 Oct 04 08:54:16.272287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 147/298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:16 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:16.277321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c1f9ce14-a377-45e4-b86d-bef064b26aaf tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Action: 'create', calling method: .version_select at 0x7f6f1a80b1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1894365493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQcRvtEP5uW97qjv6IjZ5OWrF2MLmCRWHrqk/bIGype9NADmKND9n5OLFkCbOormDuPQ7FtX79nkvhn79FkJcwFyGcb7v0qvUil6qO5TBWysNl0DzomK+cvtYL9KEguuQ=="}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:16.293388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-c1f9ce14-a377-45e4-b86d-bef064b26aaf tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Getting quotas for project f6f4de2e638d4746a56a2d2023d2401b. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:16.297246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-c1f9ce14-a377-45e4-b86d-bef064b26aaf tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Getting quotas for user 21628ccf9dfb4ad1921aaf27712031c0 and project f6f4de2e638d4746a56a2d2023d2401b. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:16.383556 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c1f9ce14-a377-45e4-b86d-bef064b26aaf tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.109606 Oct 04 08:54:16.384077 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 148/299] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:54:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:16.498332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1839937145", "imageRef": "47976cb5-f3c0-4251-aeb9-7574a242e793", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1894365493", "networks": [{"uuid": "4bbb976b-3b1d-417f-9eb1-47edd4a962af"}]}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:16.555696 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.network.neutron [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] validate_networks() for [('4bbb976b-3b1d-417f-9eb1-47edd4a962af', None, None, None, None, None)] {{(pid=127549) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:54:16.998361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Flavor limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:54:16.998974 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Image limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:54:16.999278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Flavor pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:54:16.999775 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Image pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:54:17.000218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:54:17.010720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:17.011187 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:17.011734 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:17.012483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:17.012927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:17.013345 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:17.030517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Getting quotas for project f6f4de2e638d4746a56a2d2023d2401b. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:17.034660 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Getting quotas for user 21628ccf9dfb4ad1921aaf27712031c0 and project f6f4de2e638d4746a56a2d2023d2401b. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:17.045464 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Going to run 1 instances... {{(pid=127549) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:54:17.048044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='47976cb5-f3c0-4251-aeb9-7574a242e793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:54:17.227474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8462a731-45cc-499d-80bc-4a5b0be45b8f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733105 Oct 04 08:54:17.228302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 149/300] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:54:17.232852 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:17.233525 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:17.239943 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:17.244682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:17.244682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:17.244682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:17.244682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:17.245223 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:17.407243 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:17.415723 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:17.417270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:17.418433 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a3ac2382-beec-479d-810d-f3a1ea9e1f4c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1742 microversion: 2.20 time: 0.189219 Oct 04 08:54:17.419056 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 150/301] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:17 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:17.423583 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-32981960-4c37-4df5-a9e9-340970150c4f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:17.424159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-32981960-4c37-4df5-a9e9-340970150c4f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:17.476582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-32981960-4c37-4df5-a9e9-340970150c4f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:17.483391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-32981960-4c37-4df5-a9e9-340970150c4f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1259 microversion: 2.1 time: 0.063410 Oct 04 08:54:17.483984 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 151/302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:17 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1259 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:17.488597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:17.489195 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:17.502025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:17.502025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:17.502025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:17.502025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:17.502440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:17.502440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:17.642221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:17.650761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f613af5e-07ba-4051-8838-19e951874796 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1516 microversion: 2.1 time: 0.165745 Oct 04 08:54:17.656712 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 152/303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:17 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:17.995271 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1929a52f-d49f-4a6d-8983-c430aa6e3d49 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "POST /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.287455 Oct 04 08:54:17.996208 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 152/304] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:54:15 2022] POST /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1/os-volume_attachments => generated 194 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:18.447331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:18.447997 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:18.455419 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:18.455897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:18.456331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:18.457022 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:18.457470 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:18.457893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:18.509131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-98453599-9676-4647-8841-6d5692fa82d9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:18.509834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-98453599-9676-4647-8841-6d5692fa82d9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:18.566129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-98453599-9676-4647-8841-6d5692fa82d9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:18.574955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-98453599-9676-4647-8841-6d5692fa82d9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1259 microversion: 2.1 time: 0.071972 Oct 04 08:54:18.575893 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 153/305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:18 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:18.630495 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:18.637679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:18.639221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:18.640378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d7fe9aa9-33ca-4c08-bd0f-adc0520a48a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1742 microversion: 2.20 time: 0.197907 Oct 04 08:54:18.640933 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 153/306] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:18 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1742 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:19.395236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a812b2d1-3cf1-45ce-a24b-676492d7f832 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'create', calling method: .version_select at 0x7f6f1a78b820>, body: {"keypair": {"name": "tempest-keypair-1801306188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw5uKqHZNXP+lgzKGZmNRHq/7BzInFMGClgqsW6aGIj8dIrkCefqf7G7aTMQyYcWT18LlCkEMn9rW154oU0skUP3TqnKNQ1UXftokbEKV0iTbbTXjF2R8zPyvQxOWnb7w=="}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:19.410651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-a812b2d1-3cf1-45ce-a24b-676492d7f832 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Getting quotas for project 24b4590edfe642bc8a8bd15a1b8ba464. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:19.414892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-a812b2d1-3cf1-45ce-a24b-676492d7f832 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Getting quotas for user 185e359e571f44bda1585124529b36a8 and project 24b4590edfe642bc8a8bd15a1b8ba464. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:19.538717 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a812b2d1-3cf1-45ce-a24b-676492d7f832 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147192 Oct 04 08:54:19.539320 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 154/307] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:54:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:19.598642 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:19.599264 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:19.606238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:19.606998 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:19.607434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:19.608315 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:19.608750 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:19.609334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:19.665958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:19.666840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:19.680023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:19.680754 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:19.681822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:19.683334 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:19.683800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:19.684232 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:19.685269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:19.696039 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d903eb1a-fa38-4296-9562-1a07a76fc783 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1311 microversion: 2.1 time: 0.101149 Oct 04 08:54:19.709082 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 154/308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:19 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:19.849885 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:19.868057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:19.869533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:19.870736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-58bb3751-2aba-4587-9827-4f34b21195a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1742 microversion: 2.20 time: 0.208794 Oct 04 08:54:19.873554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 155/309] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:19 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1742 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:20.370582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-03a18057-e6e3-451b-b539-26d7a336b103 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: .version_select at 0x7f6f1a61a3a0>, body: {"keypair": {"name": "tempest-keypair-1113257061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDH8DNvMaJjm15rNR4f+Rx41iRloF/Uad6Tni68Kip0HODIc6S8Kx76ywAXavu8aYbTz/BWeyfkNiKgnYT12B23FLDQHiJZhEcLKLssCxfNjPASPBAC21kvaVvg7jrniYg=="}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:20.388742 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-03a18057-e6e3-451b-b539-26d7a336b103 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for project 8760be982f804a9aa319b989aa1c3118. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:20.398521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-03a18057-e6e3-451b-b539-26d7a336b103 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for user 14d56042415540a3b3ed06578b712ca5 and project 8760be982f804a9aa319b989aa1c3118. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:20.592731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-03a18057-e6e3-451b-b539-26d7a336b103 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.226522 Oct 04 08:54:20.593332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 155/310] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:54:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:20.723363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:20.726184 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:20.734664 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.735269 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.735939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.736749 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.737297 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.737840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.803223 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:20.811810 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7588f37e-0862-4e74-8124-2a521d2d8725 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1319 microversion: 2.1 time: 0.094388 Oct 04 08:54:20.812387 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 156/311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:20 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:20.900514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:20.901132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:20.907835 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.908381 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.908850 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:20.909975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:20.910722 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:20.911251 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:21.082779 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:21.093577 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:21.095430 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:21.098839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-58c03f6d-20f6-4b94-8334-79943261b98f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1737 microversion: 2.20 time: 0.201371 Oct 04 08:54:21.099875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 156/312] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:20 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:21.838291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:21.839113 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:21.852758 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.853322 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:21.853780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:21.854701 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.855216 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:21.855652 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:21.971661 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-8710e315-08b6-4502-b34e-d47b327552c7 req-c70fd240-17ac-4075-9ab7-fb4e9e23f15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acaf703d-ba5c-4518-a5d9-afa1a34dcfd1", "name": "network-vif-plugged", "status": "completed", "tag": "e0969193-60ee-4fb7-ba1b-70b50bfb9b9d"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:21.998850 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8710e315-08b6-4502-b34e-d47b327552c7 req-c70fd240-17ac-4075-9ab7-fb4e9e23f15e service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:21.999429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8710e315-08b6-4502-b34e-d47b327552c7 req-c70fd240-17ac-4075-9ab7-fb4e9e23f15e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:22.000336 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8710e315-08b6-4502-b34e-d47b327552c7 req-c70fd240-17ac-4075-9ab7-fb4e9e23f15e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:22.025627 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-8710e315-08b6-4502-b34e-d47b327552c7 req-c70fd240-17ac-4075-9ab7-fb4e9e23f15e service nova] Creating event network-vif-plugged:e0969193-60ee-4fb7-ba1b-70b50bfb9b9d for instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 on hv-cinder-85944 Oct 04 08:54:22.033554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-8710e315-08b6-4502-b34e-d47b327552c7 req-c70fd240-17ac-4075-9ab7-fb4e9e23f15e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065936 Oct 04 08:54:22.039186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 157/313] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:22.070671 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:22.105409 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-61bc2e8a-7bfb-4bf8-be7e-7470c708ceb7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1317 microversion: 2.1 time: 0.270785 Oct 04 08:54:22.107784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 157/314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:21 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:22.140919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:22.142196 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:22.159369 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:22.160058 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:22.161223 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:22.162139 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:22.172522 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:22.173249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:22.833501 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:22.844153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:22.846495 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:22.848035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-31f37487-4086-45e5-8d21-a54a9f566081 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1737 microversion: 2.20 time: 0.716101 Oct 04 08:54:22.849201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 158/315] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:22 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1737 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:23.131492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:23.133112 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:23.148694 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.148694 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.148694 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:23.149094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.151678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.152408 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:23.361978 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-869983132", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff082fc8-e1db-4811-948c-1101d0759e1f"}], "security_groups": [{"name": "tempest-securitygroup--2079205178"}], "key_name": "tempest-keypair-1801306188", "user_data": "}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:23.501440 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:23.512833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c180577b-8d20-4289-9f87-99f498c84c61 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.386054 Oct 04 08:54:23.513924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 158/316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:23 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:23.879012 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:23.879528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:23.899143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.903160 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.904916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:23.908396 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:23.909150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:23.910582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:24.307641 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:24.321973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:24.325299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:24.326534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c6cf9738-f43e-4925-b286-133823b97046 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1737 microversion: 2.20 time: 0.452980 Oct 04 08:54:24.330740 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 159/317] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:23 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1737 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:24.361985 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-62b812fb-c67d-4eb9-a0bb-7984911efc19 req-776d01f4-0c69-4c07-97b3-36e6ae2e66e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a4610c-eb87-46b5-bdb5-25c521d71a5d", "tag": "4016b744-a552-4b39-96d5-0dd5bd2f34c4"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:24.404043 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-62b812fb-c67d-4eb9-a0bb-7984911efc19 req-776d01f4-0c69-4c07-97b3-36e6ae2e66e2 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:24.406890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-62b812fb-c67d-4eb9-a0bb-7984911efc19 req-776d01f4-0c69-4c07-97b3-36e6ae2e66e2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:24.407924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-62b812fb-c67d-4eb9-a0bb-7984911efc19 req-776d01f4-0c69-4c07-97b3-36e6ae2e66e2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:24.430044 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-62b812fb-c67d-4eb9-a0bb-7984911efc19 req-776d01f4-0c69-4c07-97b3-36e6ae2e66e2 service nova] Creating event network-changed:4016b744-a552-4b39-96d5-0dd5bd2f34c4 for instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d on hv-cinder-85944 Oct 04 08:54:24.437629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-62b812fb-c67d-4eb9-a0bb-7984911efc19 req-776d01f4-0c69-4c07-97b3-36e6ae2e66e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079754 Oct 04 08:54:24.439001 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 160/318] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:24.540059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:24.541873 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:24.567989 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:24.570515 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:24.572704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:24.575651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:24.576164 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:24.582949 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.037023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:25.099763 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9247214a-fcb7-4431-bd58-8e4c86005d57 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.560408 Oct 04 08:54:25.115839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 161/319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:24 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:25.361955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:25.362719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:25.374741 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.375458 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.376054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.378501 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:25.379165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:25.387665 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:25.574270 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:25.588096 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:25.589627 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:25.591308 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-835efb41-f97a-458d-9c8d-3775b32766c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1737 microversion: 2.20 time: 0.233300 Oct 04 08:54:25.594653 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 162/320] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:25 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:26.132534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:26.133151 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:26.152751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.153264 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.153708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.160970 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.168699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.169204 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.573251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:26.583599 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-960de3ba-db29-4d85-aff0-57a010fc5e95 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.455393 Oct 04 08:54:26.601326 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 163/321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:26 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:26.622884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:26.635660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:26.653356 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.654123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.660656 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.661682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:26.665537 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:26.666206 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:26.969657 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:26.983120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:26.989411 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:26.990847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b30a24e5-f503-483a-bcef-0d340e663cab tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1737 microversion: 2.20 time: 0.371859 Oct 04 08:54:26.993878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 164/322] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:26 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1737 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:27.004802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1599268443", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38eace1c-70a5-4e3a-880c-50986fb2cf27"}], "security_groups": [{"name": "tempest-securitygroup--1049300196"}], "key_name": "tempest-keypair-1113257061", "user_data": "}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:27.021367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:29.421588 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=6 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:30.401238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=16 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:32.838873 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=44 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:33.392828 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:34.705123 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.network.neutron [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] validate_networks() for [('ff082fc8-e1db-4811-948c-1101d0759e1f', None, None, None, None, None)] {{(pid=127549) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:54:34.805205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] validate_networks() for [('38eace1c-70a5-4e3a-880c-50986fb2cf27', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:54:35.630478 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Flavor limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:54:35.630903 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Image limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:54:35.631825 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Flavor pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:54:35.632266 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Image pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:54:35.632700 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:54:35.642477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.642966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.643408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.644132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.644597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.645022 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.659713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:54:35.660493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:54:35.661277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:54:35.661786 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:54:35.662275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:54:35.664823 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Getting quotas for project 24b4590edfe642bc8a8bd15a1b8ba464. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:35.665160 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:35.669067 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Getting quotas for user 185e359e571f44bda1585124529b36a8 and project 24b4590edfe642bc8a8bd15a1b8ba464. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:35.673111 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.673848 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.674504 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.676046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.676046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.676753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.682582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Going to run 1 instances... {{(pid=127549) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:54:35.685123 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:54:35.699414 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for project 8760be982f804a9aa319b989aa1c3118. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:54:35.703763 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for user 14d56042415540a3b3ed06578b712ca5 and project 8760be982f804a9aa319b989aa1c3118. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:54:35.716290 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:54:35.718830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:54:35.841685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7a065a37-a81f-4391-9b84-20334a4a0b6a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 12.484231 Oct 04 08:54:35.848445 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 159/323] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:54:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 12486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 08:54:35.848445 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:35.848776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:35.854877 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.860233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.860233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.860233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.860233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.860551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.870746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-48e19e7f-cf83-469d-8eb2-565edff041e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.875165 Oct 04 08:54:35.880880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 165/324] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:54:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 8886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:54:35.892205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:35.892818 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:35.912242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.912763 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.914098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:35.915160 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:35.915584 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:35.918443 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:36.063253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.076800 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ef1e8e56-477f-4b48-b29c-7f5f02353460 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.232481 Oct 04 08:54:36.077621 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 160/325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:35 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:36.082227 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4406265a-b255-4d57-b180-0f441d0aee4a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:36.083073 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4406265a-b255-4d57-b180-0f441d0aee4a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:36.106306 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.116853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.118763 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.119934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-271e50d3-99ca-451a-95e6-8ea49de20ce2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1737 microversion: 2.20 time: 0.236313 Oct 04 08:54:36.120676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 166/326] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:35 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:36.124985 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7fbfaab3-c614-4bef-946c-e7e662b80b45 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:36.125582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7fbfaab3-c614-4bef-946c-e7e662b80b45 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:36.148414 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4406265a-b255-4d57-b180-0f441d0aee4a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.156133 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4406265a-b255-4d57-b180-0f441d0aee4a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1245 microversion: 2.1 time: 0.077349 Oct 04 08:54:36.156767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 161/327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:36 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:36.186965 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7fbfaab3-c614-4bef-946c-e7e662b80b45 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:36.189295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7fbfaab3-c614-4bef-946c-e7e662b80b45 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1242 microversion: 2.1 time: 0.067656 Oct 04 08:54:36.189849 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 167/328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:36 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:37.100792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:37.101402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:37.108703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.109177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.109604 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.110281 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.110759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.111180 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.145994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:37.146745 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:37.153089 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.153692 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.154123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.154861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.155314 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.155736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.289411 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.297253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1d8f944c-c65e-457d-9b31-88af3ea76f1a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.200375 Oct 04 08:54:37.298559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 162/329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:37 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:37.304605 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:37.305449 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:37.316325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.316726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.317156 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.317853 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.318328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.318803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.320581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.328778 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.330496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.331707 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2e030ead-1d35-4366-88d8-e582671d7581 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1737 microversion: 2.20 time: 0.189570 Oct 04 08:54:37.332266 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 168/330] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:37 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:37.336902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:37.337687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:37.343761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.344418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.348558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.348558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:37.348558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:37.348558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:37.388438 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.396884 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7ab116ab-05f9-496c-bce2-ec74cbf33443 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1241 microversion: 2.1 time: 0.096927 Oct 04 08:54:37.397725 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 163/331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:37 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:37.415468 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:37.423407 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b51661b6-3c67-4ca2-90d5-4078b167234d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1246 microversion: 2.1 time: 0.090032 Oct 04 08:54:37.424363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 169/332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:37 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:38.322927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:38.323528 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:38.330031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.330543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.330976 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.331664 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.332109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.332527 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.357629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:38.358252 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:38.364986 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.365491 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.366619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.367319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.367778 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.368264 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.517557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:38.526022 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a0186dde-9bfe-41a5-b386-215312165674 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.208764 Oct 04 08:54:38.526610 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 164/333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:38 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:38.531036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:38.531631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:38.538712 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.539200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.539647 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.540322 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.540769 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.541191 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.546064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:38.554635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:38.556093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:38.557254 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0b5ed717-2d0c-4b7a-8525-cc2cc0b6b710 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1719 microversion: 2.20 time: 0.203654 Oct 04 08:54:38.557808 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 170/334] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:38 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:38.562270 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:38.562910 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:38.568549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.569039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.569482 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.570179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:38.572529 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:38.573362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:38.603176 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:38.610736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4ed8520f-091b-4686-82cd-6770355fff34 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1297 microversion: 2.1 time: 0.083152 Oct 04 08:54:38.611301 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 165/335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:38 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:38.633156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:38.640593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0777a6d2-7689-4b68-aa0a-d0bc512b8114 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1238 microversion: 2.1 time: 0.081654 Oct 04 08:54:38.641151 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 171/336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:38 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:39.549146 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:39.549860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:39.557105 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.557787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.558165 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.558894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.559348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.559770 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.585454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:39.586242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:39.593529 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.594396 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.595731 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.597026 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.597590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.598135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.604177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:39.764282 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.772958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-333cc8b3-23b2-4dd3-b657-3f2486f86f27 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.226864 Oct 04 08:54:39.773614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 166/337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:39 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:39.786531 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:39.786531 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:39.786531 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.786531 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.786946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.786946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.789015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.789015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.792762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.800846 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.802289 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.803478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-640fa859-7ca4-4a55-8d17-65210cad9f88 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1719 microversion: 2.20 time: 0.222488 Oct 04 08:54:39.804196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 172/338] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:39 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:39.808488 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:39.809091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:39.815186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.815676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.816105 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.816789 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:39.817245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:39.817668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:39.851622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.858476 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-83000d1a-d1b7-4ac5-ba07-1d650cb5405c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1305 microversion: 2.1 time: 0.083735 Oct 04 08:54:39.859327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 167/339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:39 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1305 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:39.879898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:39.888013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b3309e46-ea51-47b9-92fc-ed1985fb2008 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1294 microversion: 2.1 time: 0.082870 Oct 04 08:54:39.888570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 173/340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:39 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:40.795777 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:40.796394 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:40.802781 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.803799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.804241 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.804935 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.805392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.805821 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.832041 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:40.832679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:40.839281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.839767 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.840205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.840902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:40.841356 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:40.841779 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:40.989203 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:40.997382 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2eeb88d2-571c-4a54-bdda-bde3391ceca7 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.205436 Oct 04 08:54:40.997945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 168/341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:40 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:41.002302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:41.002925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:41.010699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.014351 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.014908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.015346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.016053 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.016504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.016921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.018594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.020022 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.021156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-dd646f6a-aced-44f5-b9ac-304412982ada tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1719 microversion: 2.20 time: 0.193014 Oct 04 08:54:41.021716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 174/342] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:40 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1719 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:41.026151 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:41.026782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:41.032342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.032826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.033261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.033939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:41.034385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:41.034828 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:41.083226 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.091102 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6dfe8f12-db2a-4022-82fd-2788ee41c302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1305 microversion: 2.1 time: 0.092155 Oct 04 08:54:41.091764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 169/343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:40 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:41.112748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:41.121288 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-fd3b8791-091c-427e-a067-61c44724da17 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1294 microversion: 2.1 time: 0.098651 Oct 04 08:54:41.121842 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 175/344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:41 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:42.021124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:42.021739 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:42.029510 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.030075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.030544 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.031242 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.031700 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.032131 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.047318 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:42.047937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:42.054228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.054741 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.055175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.055854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.056300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.056719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.251095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:42.254553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:42.259985 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cd182b31-0e59-46d7-8b51-3dbf3af102f5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.242690 Oct 04 08:54:42.260647 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 170/345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:42 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:42.265225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:42.265827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:42.272473 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.273240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.273682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.274451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.274904 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.275309 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:42.275442 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.276922 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:42.278465 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-01a24192-c208-4309-b191-55f92368860c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1719 microversion: 2.20 time: 0.234959 Oct 04 08:54:42.287595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 176/346] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:42 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1719 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:42.292108 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:42.297195 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:42.300976 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.301464 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.301905 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.302638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.303092 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.303901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.353843 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:42.363016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b481e182-2526-4983-acf9-8a5dc8bb6598 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1305 microversion: 2.1 time: 0.101312 Oct 04 08:54:42.363596 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 171/347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:42 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:42.381483 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:42.389705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0e20b09c-ad24-49f8-bc42-2e5cd094efac tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1294 microversion: 2.1 time: 0.108061 Oct 04 08:54:42.390273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 177/348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:42 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:42.737025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-be1509b9-ae20-433b-a15d-d94ea0e287dc req-490e1f2b-85df-49ef-b9e7-56bdccac5911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acaf703d-ba5c-4518-a5d9-afa1a34dcfd1", "name": "network-vif-unplugged", "status": "completed", "tag": "e0969193-60ee-4fb7-ba1b-70b50bfb9b9d"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:42.776387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-be1509b9-ae20-433b-a15d-d94ea0e287dc req-490e1f2b-85df-49ef-b9e7-56bdccac5911 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:42.776901 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-be1509b9-ae20-433b-a15d-d94ea0e287dc req-490e1f2b-85df-49ef-b9e7-56bdccac5911 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:42.777295 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-be1509b9-ae20-433b-a15d-d94ea0e287dc req-490e1f2b-85df-49ef-b9e7-56bdccac5911 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:42.795445 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-be1509b9-ae20-433b-a15d-d94ea0e287dc req-490e1f2b-85df-49ef-b9e7-56bdccac5911 service nova] Creating event network-vif-unplugged:e0969193-60ee-4fb7-ba1b-70b50bfb9b9d for instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 on hv-cinder-85944 Oct 04 08:54:42.802174 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-be1509b9-ae20-433b-a15d-d94ea0e287dc req-490e1f2b-85df-49ef-b9e7-56bdccac5911 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069569 Oct 04 08:54:42.803107 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 172/349] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:43.295087 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:43.296240 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:43.306396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:43.307132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:43.317232 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.317733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.321826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.321826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.321826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.321826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.322868 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.323518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.323675 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.324573 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.325032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.326645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.604851 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.615406 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9be5dc38-33d4-4c19-8146-4bd9e038b3b5 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.324236 Oct 04 08:54:43.617396 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 178/350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:43 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:43.618395 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.623907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:43.625120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:43.633547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.633947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.634482 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.635338 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.635761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.636807 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.638183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.638844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.639930 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8e7e43df-9d6f-4237-a4fd-a15823f582b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1722 microversion: 2.20 time: 0.338627 Oct 04 08:54:43.642649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 173/351] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:43 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:43.655940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:43.658078 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:43.670354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.670876 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.671309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.672007 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.677885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.678725 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.798011 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.807721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-42159f65-7c51-4069-8fa9-5701b5c55796 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1302 microversion: 2.1 time: 0.163095 Oct 04 08:54:43.808309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 174/352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:43 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1302 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:43.818563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "283bb40c-d2ed-4cc3-9e1e-177b492ff431"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:43.827498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:43.836707 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.837101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.837585 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.838293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:43.838788 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:43.839208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:43.950972 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:43.960643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6ec9e772-3a3a-43e1-a83a-2834021ac82f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.341714 Oct 04 08:54:43.963076 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 179/353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:43 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:44.641190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:44.641892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:44.648739 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.649515 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.649958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.650704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.651198 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.651626 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.793776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:44.802259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a6d94d3b-c5dd-4c61-a33f-422e1dee28b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.165357 Oct 04 08:54:44.803139 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 180/354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:44 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:44.819252 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-f71c79b1-7213-4625-9925-4b618008d3eb req-8c2ffc76-32fa-4202-b30a-5ecce6ebb894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a4610c-eb87-46b5-bdb5-25c521d71a5d", "name": "network-vif-plugged", "status": "completed", "tag": "4016b744-a552-4b39-96d5-0dd5bd2f34c4"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:44.829847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f71c79b1-7213-4625-9925-4b618008d3eb req-8c2ffc76-32fa-4202-b30a-5ecce6ebb894 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.830328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f71c79b1-7213-4625-9925-4b618008d3eb req-8c2ffc76-32fa-4202-b30a-5ecce6ebb894 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.830797 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f71c79b1-7213-4625-9925-4b618008d3eb req-8c2ffc76-32fa-4202-b30a-5ecce6ebb894 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.843292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-f71c79b1-7213-4625-9925-4b618008d3eb req-8c2ffc76-32fa-4202-b30a-5ecce6ebb894 service nova] Creating event network-vif-plugged:4016b744-a552-4b39-96d5-0dd5bd2f34c4 for instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d on hv-cinder-85944 Oct 04 08:54:44.848270 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-f71c79b1-7213-4625-9925-4b618008d3eb req-8c2ffc76-32fa-4202-b30a-5ecce6ebb894 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032717 Oct 04 08:54:44.848859 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 181/355] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:44.858256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:44.859142 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:44.865296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.865783 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.866218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.867655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.868107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.868535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.925739 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:44.932935 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:44.941012 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9d55b18d-8fe9-470b-ada3-aa232936459f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1300 microversion: 2.1 time: 0.087301 Oct 04 08:54:44.941583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 182/356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:44 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:44.987286 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:44.987934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:44.995046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.995541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.995982 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:44.996677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:44.997135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:44.997558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.030655 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e28161b1-d1dd-46f4-896c-9116b34a9d7e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.221206 Oct 04 08:54:45.031291 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 175/357] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Oct 4 08:54:43 2022] POST /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments => generated 188 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:54:45.136993 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.146149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4590b41e-1f52-4ee7-84b6-24982d5752f5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.162854 Oct 04 08:54:45.146986 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 183/358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:44 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:45.171862 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:45.172455 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:45.178785 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.179932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.180574 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.181346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.181806 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.182235 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.208708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-4ec5c112-b8e9-44af-ba25-08caaea03c10 req-ddf88874-6a1c-468b-8dee-9a0bca527914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836bad03-671e-48e3-8931-55435b0139d5", "tag": "58411766-09ff-4773-bf48-970dc9dc8309"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:45.219943 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-4ec5c112-b8e9-44af-ba25-08caaea03c10 req-ddf88874-6a1c-468b-8dee-9a0bca527914 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.219943 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-4ec5c112-b8e9-44af-ba25-08caaea03c10 req-ddf88874-6a1c-468b-8dee-9a0bca527914 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.219943 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-4ec5c112-b8e9-44af-ba25-08caaea03c10 req-ddf88874-6a1c-468b-8dee-9a0bca527914 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.228961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127549) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 08:54:45.232792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-4ec5c112-b8e9-44af-ba25-08caaea03c10 req-ddf88874-6a1c-468b-8dee-9a0bca527914 service nova] Creating event network-changed:58411766-09ff-4773-bf48-970dc9dc8309 for instance 836bad03-671e-48e3-8931-55435b0139d5 on hv-cinder-85944 Oct 04 08:54:45.238078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-4ec5c112-b8e9-44af-ba25-08caaea03c10 req-ddf88874-6a1c-468b-8dee-9a0bca527914 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033180 Oct 04 08:54:45.239011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 184/359] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:45.532598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9cd7dcbf-1617-4fa6-b3fa-5e4f70d96766 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/action" status: 202 len: 0 microversion: 2.20 time: 0.364785 Oct 04 08:54:45.533206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 176/360] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 4 08:54:45 2022] POST /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:54:45.542800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:45.543706 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:45.550534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.551104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.551614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.552492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.552939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.553389 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.686997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.689296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:45.696312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.697750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.698947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-76115136-d5fb-47b2-bbee-0db16f497664 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1748 microversion: 2.20 time: 0.161365 Oct 04 08:54:45.699498 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 185/361] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:45 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:45.822087 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:45.826021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:45.826702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:45.833130 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.833600 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.834109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.834711 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.835167 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.836238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.965970 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:45.966680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:45.973015 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.973494 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.974143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.974857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:45.975316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:45.975736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:45.975860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:45.984594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-da1decf6-2f66-4b1d-8670-ef8e5b8bd60f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.162933 Oct 04 08:54:45.985169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 177/362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:45 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:46.108670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:46.116349 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-abef7457-579f-488a-9b6e-995fa0f17ff0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.155589 Oct 04 08:54:46.117055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 186/363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:45 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:46.172332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:46.173136 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:46.175198 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=8 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:46.180554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.181031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.181606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.182334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.183400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.183773 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.318705 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:46.329141 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7859258c-c442-4b06-9ddf-37c66031e867 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.158996 Oct 04 08:54:46.329141 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 178/364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:46 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:46.724441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:46.724966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:46.727078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=8 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:46.732640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.732867 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.733309 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.734009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:46.734495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:46.734928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:46.869548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:46.879343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:46.880782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:46.882242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-884e4039-43c2-4add-bd28-d0f86a8387cb tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1748 microversion: 2.20 time: 0.161973 Oct 04 08:54:46.887676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 187/365] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:46 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:47.008562 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:47.009168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:47.015275 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.015757 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.017280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.017280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.017472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.019634 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.140881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:47.141581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:47.144576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:47.147690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.148639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.149079 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.149774 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.150222 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.150672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.152542 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-92295f50-70f2-4dfd-b40b-adecdab937b8 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.148644 Oct 04 08:54:47.153110 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 179/366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:47 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:47.276682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:47.284281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e5aae956-046a-4790-a0bd-d04980b526aa tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.147593 Oct 04 08:54:47.284842 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 188/367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:47 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:47.356494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:47.357244 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:47.364030 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.367472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.367472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.367472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.367472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.367927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.520365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:47.529527 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d0929fab-d2bf-4857-93a0-f60dcabec2d2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.183654 Oct 04 08:54:47.530691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 180/368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:47 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:47.909257 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:47.910192 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:47.916280 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.916781 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.917216 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:47.917943 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:47.918392 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:47.918874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.052199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:48.061186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:48.062651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:48.063799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-27a22bb5-eef2-48e2-bd48-bfa6d8c6bb21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1750 microversion: 2.20 time: 0.158529 Oct 04 08:54:48.064346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 189/369] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:47 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:48.175814 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:48.177093 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:48.184021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.184539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.184978 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.185683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.186137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.186596 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.313233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:48.313233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:48.315505 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.315986 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.316418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.317105 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.317726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.318155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.323574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:48.333361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:48.344006 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c9247275-3967-411f-838f-98b238b71bb2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.172094 Oct 04 08:54:48.344736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 181/370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:48 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:48.462576 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:48.470465 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-337e90ed-ce65-4972-a2dd-69e8e9cce564 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.165839 Oct 04 08:54:48.471209 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 190/371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:48 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:48.555306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:48.556263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:48.563254 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.564179 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.564934 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.565688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.566310 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.566769 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.707742 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:48.715477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cf6706ff-cc78-4da0-a19b-6e315351591f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.164838 Oct 04 08:54:48.716046 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 182/372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:48 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:48.799723 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-1a6eb12c-e37a-4f17-b43c-624e386c843b req-f97ead74-0720-4f0a-9bde-f464e66e0676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6871eef-a47d-4c71-b1c8-4dc6aee127e5", "tag": "e5a9fd37-19a7-4033-ac7c-1d59710ef898"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:48.810024 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-1a6eb12c-e37a-4f17-b43c-624e386c843b req-f97ead74-0720-4f0a-9bde-f464e66e0676 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:48.810624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-1a6eb12c-e37a-4f17-b43c-624e386c843b req-f97ead74-0720-4f0a-9bde-f464e66e0676 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:48.811122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-1a6eb12c-e37a-4f17-b43c-624e386c843b req-f97ead74-0720-4f0a-9bde-f464e66e0676 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:48.823355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-1a6eb12c-e37a-4f17-b43c-624e386c843b req-f97ead74-0720-4f0a-9bde-f464e66e0676 service nova] Creating event network-changed:e5a9fd37-19a7-4033-ac7c-1d59710ef898 for instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 on hv-cinder-85944 Oct 04 08:54:48.827591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-1a6eb12c-e37a-4f17-b43c-624e386c843b req-f97ead74-0720-4f0a-9bde-f464e66e0676 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032077 Oct 04 08:54:48.828165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 191/373] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:49.089811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:49.090358 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:49.096277 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.096752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.097182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.097866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.098314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.098814 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.228907 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.237353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.238825 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.239964 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a03231b4-f892-45d2-8c57-25ff4eb32292 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1750 microversion: 2.20 time: 0.154356 Oct 04 08:54:49.240539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 183/374] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:49 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:49.372692 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:49.373313 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:49.379928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.380408 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.380977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.381944 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.382710 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.383140 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.495246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:49.495858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:49.501640 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.502125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.502594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.503278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.503724 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.504144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.512302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.519852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8d743973-ff90-4c28-b137-d6371bed8e16 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.151417 Oct 04 08:54:49.520411 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 192/375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:49 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:49.635212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.642925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6cb15513-4fcc-4244-8dac-7b50545082d9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.152160 Oct 04 08:54:49.643488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 184/376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:49 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:49.738853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:49.739461 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:49.745946 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.746455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.746895 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.747581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:49.748065 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:49.748491 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:49.872131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:49.879727 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9994899e-1ffa-413b-9d18-5a8933343252 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.144677 Oct 04 08:54:49.880282 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 193/377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:49 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:50.266170 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:50.266803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:50.272746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.273509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.273948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.274663 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.275371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.275794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.415016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.423468 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.424909 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.426055 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1ad12942-f98b-4a8c-bdea-affd6e9e2133 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1750 microversion: 2.20 time: 0.163763 Oct 04 08:54:50.426645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 185/378] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:50 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:50.543401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:50.543959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:50.550454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.550947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.554643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.554643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.554643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.554643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.666292 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:50.667252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:50.675042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.675536 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.675979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.676684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.677138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.677570 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.684302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.692124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-38086494-023e-4e30-a9d1-d3412f479911 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.153468 Oct 04 08:54:50.692791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 194/379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:50 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:50.805421 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:50.813540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-37620ad8-395c-471a-be9b-bdc3c2769519 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.151962 Oct 04 08:54:50.814112 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 186/380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:50 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:50.903948 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:50.904613 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:50.910629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.911112 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.911546 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:50.912225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:50.912673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:50.913092 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.042037 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.049530 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d324365a-5a36-4be3-80b0-ff07a4f176f7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.149393 Oct 04 08:54:51.050084 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 195/381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:50 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:51.451915 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:51.452523 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:51.458543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.459029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.459467 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.460150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.460669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.461136 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.584793 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.593498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.594975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.596137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1c20f9ac-5f9c-4ac2-b51d-60ff86cc9718 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1750 microversion: 2.20 time: 0.148135 Oct 04 08:54:51.596705 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 187/382] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:51 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1750 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:51.715454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:51.715972 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:51.722329 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.722910 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.723350 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.724036 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.724487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.724932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.837710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:51.838323 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:51.844546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.845294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.845735 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.846648 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:51.847182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:51.855393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:51.880632 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.890301 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-19bce30d-8a97-447e-bec0-21d62ec18c25 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1359 microversion: 2.1 time: 0.178532 Oct 04 08:54:51.891196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 196/383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:51 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:51.981922 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:51.990519 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e83826ed-58c8-4a9e-b3f6-3380099026cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.157207 Oct 04 08:54:51.991383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 188/384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:51 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:52.071587 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:52.072193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:52.078087 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.078621 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.079150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.079840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.080297 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.080723 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.208569 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:52.216438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d22220dd-e117-410d-becf-fe0796c2e58b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.149233 Oct 04 08:54:52.217267 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 197/385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:52 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:52.623537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:52.624172 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:52.630781 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.631192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.631887 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.632607 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.633062 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.633485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.783263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:52.794503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:52.794906 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:52.796093 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1db66829-b2c2-4ba6-8475-161619927b64 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1750 microversion: 2.20 time: 0.176887 Oct 04 08:54:52.797156 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 189/386] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:52 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:52.913202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:52.913868 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:52.920319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.920801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.921238 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:52.923585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:52.923585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:52.923585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.017020 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.017664 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:53.024606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.025095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.025530 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.026227 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.026706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.027135 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.080549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.088711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5029f30a-7369-4f2e-9e1c-35b200aac934 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1549 microversion: 2.1 time: 0.179400 Oct 04 08:54:53.089502 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 198/387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:52 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:53.113446 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.114049 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:53.120876 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.121362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.121796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.122513 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.122973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.123398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.195659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.199158 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:53.203685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ef3acc30-52ba-435f-b939-4452f45317f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.190456 Oct 04 08:54:53.204454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 190/388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:53.239471 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.240083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:53.247255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.247747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.248185 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.248889 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.249441 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.249875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.266566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.276252 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5146c7b4-45fd-4fdc-921e-f97223d65bfe tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1549 microversion: 2.1 time: 0.164743 Oct 04 08:54:53.276252 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 199/389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:53.296471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.301312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.302071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Searching by: {'deleted': False, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b'} {{(pid=127548) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 08:54:53.309536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.310049 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.310466 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.311994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.311994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.312335 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.404066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.408217 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.multi_cell_list [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 08:54:53.412189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-780937cb-9f54-4614-9e96-016d8dc6da9d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.176560 Oct 04 08:54:53.412764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 191/390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:53.504247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e809eb47-2012-48e0-9c9c-732c9cb5cdde tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211381 Oct 04 08:54:53.504854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 200/391] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:53.517629 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.518239 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:53.524582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.525055 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.525487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.526165 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.526645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.527065 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.653883 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:53.661731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-026c1602-bf71-487e-b7f7-c8530faed5dc tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1549 microversion: 2.1 time: 0.147958 Oct 04 08:54:53.662303 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 192/392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:53.826396 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:53.827275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:53.835378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.836481 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.836920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.840597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:53.840597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:53.840597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:53.996080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.014117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.016050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.019114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1198845e-b763-443a-9cf3-46702bf70bde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.195127 Oct 04 08:54:54.019114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 201/393] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:53 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:54:54.226770 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:54.227387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:54.234212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.234718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.235155 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.235845 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.236302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.236726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.375378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.383541 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-84d2bf61-35ac-45b1-ae44-2b48f8733265 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.160675 Oct 04 08:54:54.384897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 193/394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:54 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:54.435066 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:54.435668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:54.441448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.441933 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.444998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.444998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:54.444998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:54.444998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:54.578342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:54.586266 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-04fbc31b-3355-4226-baf4-cbe167260a26 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.155556 Oct 04 08:54:54.586921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 202/395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:54 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:55.044631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:55.045149 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:55.051244 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.051720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.052151 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.052829 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.053341 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.053763 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.182718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.191330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.192767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.193931 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6d3efc89-a70a-4615-9b68-2bcddecff40e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.153453 Oct 04 08:54:55.194508 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 194/396] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:55 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:55.407016 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:55.407622 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:55.416394 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.417425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.418288 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.419039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.419492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.419914 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.534896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:55.538757 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:55.550293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.551682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.552325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.553818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.554506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.555124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.565471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.573763 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-78805f11-5605-4fc1-9ab9-24a64206ca73 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.170597 Oct 04 08:54:55.574436 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 203/397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:55 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:55.609284 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:55.610182 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:55.616667 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.617235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.617670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.618431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:55.618880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:55.619301 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:55.761243 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:55.769304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f0e7ab59-2a87-4674-806c-e5927872ce93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.163984 Oct 04 08:54:55.769987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 204/398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:55 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:56.220775 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:56.221462 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:56.227666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.228190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.228740 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.229496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.230347 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.230867 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.399575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:56.408614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:56.410039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:56.411211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f8a32ece-0622-4dc4-9652-f332f9afc1b9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.194642 Oct 04 08:54:56.411766 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 205/399] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:56 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:56.423075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2855f454-fc0d-4fa3-94f3-5b132d390a13 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "POST /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891490 Oct 04 08:54:56.426750 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 195/400] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:54:55 2022] POST /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments => generated 194 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:54:56.434710 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:56.435412 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:56.442150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.442710 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.443149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.443853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.444308 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.444731 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.598804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:56.599510 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:56.611004 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.611912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lazy-loading 'services' on Instance uuid ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:54:56.612717 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.613945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.615566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.617588 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.619409 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.681484 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:56.816618 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:56.828841 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-55fe00e2-81b3-4a51-bd7e-aef908df09d4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.232966 Oct 04 08:54:56.844214 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 196/401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:56 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:56.849661 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:56.850613 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:56.859029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.859933 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.860678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.861556 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:56.862010 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:56.862456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:56.937624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6bf9e04f-02cc-4817-9dc2-b21291da64f9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1/os-volume_attachments/4b1656ad-184a-4ec4-b3ba-fcfb4a150493" status: 202 len: 0 microversion: 2.1 time: 0.524161 Oct 04 08:54:56.938675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 206/402] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:54:56 2022] DELETE /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1/os-volume_attachments/4b1656ad-184a-4ec4-b3ba-fcfb4a150493 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:54:57.066346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:57.075737 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-30719d2f-4e90-434d-bd14-e0484ce9d358 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.230069 Oct 04 08:54:57.076327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 197/403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:56 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:57.439624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:57.441034 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:57.449610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:57.450218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:57.450754 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:57.451547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:57.452387 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:57.452894 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:57.610476 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:57.619347 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:57.621424 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:57.622619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ae4a7f10-623d-49e5-b3b6-594ebbcb98a6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.188422 Oct 04 08:54:57.626433 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 207/404] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:57 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:57.851558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:57.852173 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:57.855256 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:57.861069 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:57.861993 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:57.862589 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:57.863066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:57.863534 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:57.863967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.063011 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:58.073513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9fc2c4ee-0e9a-43be-a01b-4a1e2d2e2886 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.225259 Oct 04 08:54:58.086160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 198/405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:57 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:58.105604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:58.106937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:58.113206 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:58.114852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.133704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.133704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.133704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.133704 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.134381 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.300104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:58.308402 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-99485e69-c37c-4343-9b73-ba3a95d20142 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.211809 Oct 04 08:54:58.309096 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 208/406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:58 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:58.359428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-3656ee54-c2f0-466c-96c7-61f3a11d2e01 req-b5122dbd-7646-4d20-b640-0bd4bcad65b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836bad03-671e-48e3-8931-55435b0139d5", "name": "network-vif-plugged", "status": "completed", "tag": "58411766-09ff-4773-bf48-970dc9dc8309"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:54:58.372697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-3656ee54-c2f0-466c-96c7-61f3a11d2e01 req-b5122dbd-7646-4d20-b640-0bd4bcad65b2 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.377091 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-3656ee54-c2f0-466c-96c7-61f3a11d2e01 req-b5122dbd-7646-4d20-b640-0bd4bcad65b2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.377091 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-3656ee54-c2f0-466c-96c7-61f3a11d2e01 req-b5122dbd-7646-4d20-b640-0bd4bcad65b2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.391379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-3656ee54-c2f0-466c-96c7-61f3a11d2e01 req-b5122dbd-7646-4d20-b640-0bd4bcad65b2 service nova] Creating event network-vif-plugged:58411766-09ff-4773-bf48-970dc9dc8309 for instance 836bad03-671e-48e3-8931-55435b0139d5 on hv-cinder-85944 Oct 04 08:54:58.400189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-3656ee54-c2f0-466c-96c7-61f3a11d2e01 req-b5122dbd-7646-4d20-b640-0bd4bcad65b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044526 Oct 04 08:54:58.415672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 199/407] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:54:58.651824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:58.653455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:58.660425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.661260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.661907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.662880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:58.663532 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:58.664149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:58.813541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:58.823508 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:58.825799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:58.827154 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-60e098cf-a4fe-49e1-8400-06237fd608d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.180089 Oct 04 08:54:58.827805 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 209/408] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:58 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:54:59.110455 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:59.111274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:59.118252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:59.118770 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:59.119211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.121300 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:59.121771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:59.122212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.284334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:59.292342 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5cf4f519-57c6-4365-b6e9-f0091d1eeda7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.186533 Oct 04 08:54:59.294848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 200/409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:59 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:54:59.331231 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:59.331833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:59.338017 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:59.339820 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:59.339976 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.340666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:59.341122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:59.341574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.480762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:54:59.490043 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0394566d-6612-46fe-803c-aeb66723e1d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.162504 Oct 04 08:54:59.492013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 210/410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:54:59 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:54:59.853079 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:54:59.853694 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:54:59.861158 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:59.861854 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:59.862300 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:54:59.863037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:54:59.863490 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:54:59.864095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.034222 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.045560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.047305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.048569 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-124f90ff-064a-4663-a247-51d2b11f716a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.199664 Oct 04 08:55:00.049990 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 201/411] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:54:59 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:00.319444 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:00.320907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:00.329892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.330809 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.332061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.334581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.335254 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.335757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.423624 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-9679c974-dd77-4560-83a0-9684329b2a37 req-dd2b5436-2c62-4547-b2c8-7174c6e38430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6871eef-a47d-4c71-b1c8-4dc6aee127e5", "name": "network-vif-plugged", "status": "completed", "tag": "e5a9fd37-19a7-4033-ac7c-1d59710ef898"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:00.440019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-9679c974-dd77-4560-83a0-9684329b2a37 req-dd2b5436-2c62-4547-b2c8-7174c6e38430 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.440572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-9679c974-dd77-4560-83a0-9684329b2a37 req-dd2b5436-2c62-4547-b2c8-7174c6e38430 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.444684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-9679c974-dd77-4560-83a0-9684329b2a37 req-dd2b5436-2c62-4547-b2c8-7174c6e38430 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.460661 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-9679c974-dd77-4560-83a0-9684329b2a37 req-dd2b5436-2c62-4547-b2c8-7174c6e38430 service nova] Creating event network-vif-plugged:e5a9fd37-19a7-4033-ac7c-1d59710ef898 for instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 on hv-cinder-85944 Oct 04 08:55:00.468331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-9679c974-dd77-4560-83a0-9684329b2a37 req-dd2b5436-2c62-4547-b2c8-7174c6e38430 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048499 Oct 04 08:55:00.469263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 202/412] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:55:00.516597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:00.517674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:00.519908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.537403 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a40d1dd1-c45a-4d6b-b1c9-050f006dc01d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.214188 Oct 04 08:55:00.537642 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.537814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 211/413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:00 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:00.537917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.537917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.537917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:00.537917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:00.538793 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:00.692403 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:00.701119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1932a4ad-9d48-4a84-b175-d041d8dca300 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.190828 Oct 04 08:55:00.711214 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 203/414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:00 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:01.080451 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:01.081052 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:01.089498 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.089983 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.090424 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.091233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.091691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.092109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.244490 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.254072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.255552 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.256979 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2e3e0b72-911b-434d-acfe-bd67dd38949c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.180336 Oct 04 08:55:01.257535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 212/415] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:01 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:01.553498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:01.554163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:01.561008 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.561495 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.561935 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.562663 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.563115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.563539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.707994 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.716475 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e022299a-dc1f-4a52-9bb7-413cd50f68d6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.167084 Oct 04 08:55:01.717239 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 204/416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:01 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:01.733498 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:01.735122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:01.741986 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.742506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.742950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.743650 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:01.744199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:01.745481 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:01.913997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:01.925801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-73dbacaa-6ded-4191-8181-9c46d85e0359 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.196537 Oct 04 08:55:01.926386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 213/417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:01 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:02.286810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:02.287697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:02.295118 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.295765 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.296352 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.297284 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.297840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.298388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.465696 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.474839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.476469 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.477631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-3f6edb67-c5b7-4ac2-9173-6effc438017b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.198270 Oct 04 08:55:02.496576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 205/418] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:02 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:02.741695 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:02.742380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:02.750243 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.750753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.751190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.752304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.752441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.752752 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.901066 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:02.917689 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5395a595-4f76-4852-bbb7-17472c9eaf04 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.180392 Oct 04 08:55:02.922949 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 214/419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:02 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:02.948689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:02.949461 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:02.956560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.957172 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.957706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:02.958528 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:02.959086 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:02.960623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.106237 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:03.124933 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c8d585eb-f12f-44be-a985-a430002046dc tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.180087 Oct 04 08:55:03.125579 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 206/420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:02 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:03.504061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:03.504672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:03.508669 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:03.512772 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.513260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.513693 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.514386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.514995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.515480 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.654072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:03.663290 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:03.664841 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:03.666008 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5d40ed0f-87c1-4d83-befb-f4f869be70c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.165908 Oct 04 08:55:03.667319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 215/421] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:03 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:03.941749 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:03.942486 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:03.949944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.950631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.951106 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.951992 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:03.952895 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:03.953307 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:03.986466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:04.130563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:04.138826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2ecca634-940d-41a9-939f-fa1f1b7b65c0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.201537 Oct 04 08:55:04.139832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 207/422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:03 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:04.148962 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:04.149651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:04.157165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.158027 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.158559 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.159648 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.160426 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.160993 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.299059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:04.306884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ce869c33-2fca-4b3c-8e67-d21c4039d0e6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.161711 Oct 04 08:55:04.307529 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 216/423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:04 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:04.696842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:04.755204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:04.755204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.755204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.755204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.756159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:04.756159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:04.756159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:04.856689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:04.865820 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:04.867353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:04.868597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c00cf625-787b-47b8-a8a4-41612ab83b93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.177634 Oct 04 08:55:04.869476 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 208/424] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:04 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:05.162909 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:05.163521 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:05.171695 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.172191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.172642 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.173354 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.173808 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.175305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.309691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:05.317693 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-101934d2-b7ef-4855-9ca6-d775d9dc09e4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.158600 Oct 04 08:55:05.318255 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 217/425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:05 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:05.331082 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:05.331700 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:05.339374 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.339883 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.340311 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.341008 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.341449 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.341870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.487100 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:05.494692 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-49da008d-4b62-4799-a391-2ade37542f78 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.167634 Oct 04 08:55:05.495250 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 209/426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:05 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:05.901568 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:05.902152 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:05.908201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.908680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.909122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:05.909803 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:05.910255 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:05.910709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.050849 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.060627 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.063009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.065162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-71e5ccc0-c786-4aa8-9fad-316d4355a689 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.167787 Oct 04 08:55:06.066187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 218/427] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:05 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:06.340876 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:06.341596 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:06.350658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.351288 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.351727 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.352739 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.353633 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.354231 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.501068 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.509049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9281578e-e79d-41c1-aaf9-488b7e939a2e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.172735 Oct 04 08:55:06.516537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 210/428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:06 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:06.524762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:06.525383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:06.532515 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.533006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.533444 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.534362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:06.535009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:06.535426 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:06.681123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:06.691668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e027b6f8-5493-4d30-97fb-02581d89ce1b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.170883 Oct 04 08:55:06.692348 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 219/429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:06 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:07.097332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:07.097936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:07.104167 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.104703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.105094 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.105771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.106219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.106664 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.237287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.246624 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.248078 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.249229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-3b407f81-9171-46d0-b59d-e42b8bd355ad tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.155991 Oct 04 08:55:07.249786 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 211/430] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:07 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:07.532187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:07.532791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:07.539245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.539721 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.540149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.540825 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.541272 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.542283 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.671129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.678684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d5fabc9c-8b29-4605-b01a-617f1ee99266 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.150348 Oct 04 08:55:07.679245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 220/431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:07 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:07.715014 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:07.716184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:07.723058 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.723548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.729721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.729721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.729721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.729721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.873339 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:07.881297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d0a3d7e6-ceea-4340-a0a4-6c3daf187649 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1371 microversion: 2.1 time: 0.170634 Oct 04 08:55:07.882135 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 212/432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:07 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:07.921851 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:07.922336 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:07.928466 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.928959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.929398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.930129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:07.930626 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:07.931057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:07.954996 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-fec9c400-4d58-4ea6-8e00-022cf71cd19c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/ips" status: 200 len: 145 microversion: 2.1 time: 0.037104 Oct 04 08:55:07.955565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 221/433] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:55:07 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:08.275347 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:08.276905 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:08.283251 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.283730 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.291213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.291213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.291213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.291213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.439837 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:08.450238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:08.451751 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:08.453155 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7ae82c6e-fbd8-46b6-8983-10e513d5fa69 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.181706 Oct 04 08:55:08.453717 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 213/434] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:08 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:08.701782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:08.702386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:08.708828 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.709311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.709742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.710446 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.710904 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.711328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.850869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:08.858588 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4a91cbc8-b2db-4bba-a821-5fe407bc2704 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1368 microversion: 2.1 time: 0.161319 Oct 04 08:55:08.859154 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 222/435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:08 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:08.905159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:08.905768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:08.911648 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.912122 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.912551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:08.913230 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:08.913677 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:08.914096 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.044649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.052231 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-67c2d745-6d8a-41da-8c1f-6c86a04216ba tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1565 microversion: 2.1 time: 0.151540 Oct 04 08:55:09.052790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 214/436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:08 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:09.075187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:09.075680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:09.081471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.081950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.082385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.083089 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.083543 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.083964 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.100017 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:09.164542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ceac1894-612c-4cdd-8aa9-8e44650a1276 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093749 Oct 04 08:55:09.165129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 223/437] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 4 08:55:09 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:09.479999 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:09.480759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:09.486919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.487403 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.487846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.488546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.488997 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.489424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.636430 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.645184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.646666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:09.649714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d97c8656-3f3c-4d73-b3aa-70a1f0ad6288 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.172288 Oct 04 08:55:09.649714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 215/438] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:09 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:09.891352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:09.891352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:09.896085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.896793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.897416 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:09.898292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:09.898939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:09.899523 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.050429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:10.058479 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-aebb5c48-82c8-49c8-8e28-741eb8b560ab tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1558 microversion: 2.1 time: 0.179120 Oct 04 08:55:10.059064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 224/439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:09 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:10.085173 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:10.085719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:10.093429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.094044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.094670 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.095433 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.096866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.097377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.189019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-58040e1b-be83-4d87-957b-96c576e64ed8 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107813 Oct 04 08:55:10.189540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 216/440] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 4 08:55:10 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:10.675385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:10.676686 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:10.683675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.684408 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.684848 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.685574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.686038 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.686487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.838362 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-8a8262a0-c945-4f9d-b798-7f0882aea089 req-52bca720-01e2-48fc-b992-1df0fcf5dd4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836bad03-671e-48e3-8931-55435b0139d5", "tag": "58411766-09ff-4773-bf48-970dc9dc8309"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:10.857691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8a8262a0-c945-4f9d-b798-7f0882aea089 req-52bca720-01e2-48fc-b992-1df0fcf5dd4e service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:10.861634 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8a8262a0-c945-4f9d-b798-7f0882aea089 req-52bca720-01e2-48fc-b992-1df0fcf5dd4e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:10.862148 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8a8262a0-c945-4f9d-b798-7f0882aea089 req-52bca720-01e2-48fc-b992-1df0fcf5dd4e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:10.898951 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-8a8262a0-c945-4f9d-b798-7f0882aea089 req-52bca720-01e2-48fc-b992-1df0fcf5dd4e service nova] Creating event network-changed:58411766-09ff-4773-bf48-970dc9dc8309 for instance 836bad03-671e-48e3-8931-55435b0139d5 on hv-cinder-85944 Oct 04 08:55:10.910666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-8a8262a0-c945-4f9d-b798-7f0882aea089 req-52bca720-01e2-48fc-b992-1df0fcf5dd4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077630 Oct 04 08:55:10.912165 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 217/441] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:55:11.076411 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60826c0e-b9e1-424c-b220-572fac0657bd"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:11.076952 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:11.080490 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:11.087321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:11.089197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:11.089855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:11.090877 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:11.091013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:11.091974 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:11.092410 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:11.092862 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:11.093868 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-fe1fe865-7403-438e-aefb-7afbefc6c428 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.424045 Oct 04 08:55:11.106898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 225/442] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:10 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:12.122044 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:12.122795 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:12.129395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.129888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.130382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.131123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.131581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.132281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.269638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:12.278596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:12.280039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:12.281194 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-108b821e-f677-4f7f-aa8b-025cd1ee2261 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.163820 Oct 04 08:55:12.282398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 226/443] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:12 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:12.952071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-421f1bf9-4ec6-4aea-9525-01f8b1d14d70 req-514ec9ad-6a9e-4d4a-b8f4-c27f1cf00e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6871eef-a47d-4c71-b1c8-4dc6aee127e5", "tag": "e5a9fd37-19a7-4033-ac7c-1d59710ef898"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:12.961925 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-421f1bf9-4ec6-4aea-9525-01f8b1d14d70 req-514ec9ad-6a9e-4d4a-b8f4-c27f1cf00e07 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:12.962685 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-421f1bf9-4ec6-4aea-9525-01f8b1d14d70 req-514ec9ad-6a9e-4d4a-b8f4-c27f1cf00e07 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:12.965068 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-421f1bf9-4ec6-4aea-9525-01f8b1d14d70 req-514ec9ad-6a9e-4d4a-b8f4-c27f1cf00e07 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:12.978298 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-421f1bf9-4ec6-4aea-9525-01f8b1d14d70 req-514ec9ad-6a9e-4d4a-b8f4-c27f1cf00e07 service nova] Creating event network-changed:e5a9fd37-19a7-4033-ac7c-1d59710ef898 for instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 on hv-cinder-85944 Oct 04 08:55:12.986977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-421f1bf9-4ec6-4aea-9525-01f8b1d14d70 req-514ec9ad-6a9e-4d4a-b8f4-c27f1cf00e07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039632 Oct 04 08:55:12.988064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 227/444] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:13.309625 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:13.310244 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:13.316518 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:13.317003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:13.317438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:13.318124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:13.318611 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:13.319041 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:13.383943 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c2598f59-eebb-4503-a28d-f2742c46abf9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.312479 Oct 04 08:55:13.384966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 218/445] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:55:11 2022] POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/os-volume_attachments => generated 194 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:55:13.480374 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:13.493876 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:13.496305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:13.497973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-92c490f9-7566-4093-ad1c-0da6421067c3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.193930 Oct 04 08:55:13.499275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 228/446] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:13 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:14.529609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:14.530299 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:14.536536 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.537012 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.537444 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.538126 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.538607 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.539085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.678795 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.690311 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.696935 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.698786 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e63f178c-fb8b-44fb-b356-6301faea8724 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.174050 Oct 04 08:55:14.709503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 219/447] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:14 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:14.819262 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:14.819994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:14.827534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.828166 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.833630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.833630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:14.833630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:14.833630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:14.965947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:14.974210 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-cee3dbe8-1407-49d6-9a8f-e5b4a9d87035 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1595 microversion: 2.1 time: 0.158970 Oct 04 08:55:14.974739 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 229/448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:14 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:15.296223 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:15.296724 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:15.304965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.305645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.306083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.306803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.307362 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.307783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.334818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:55:15.665300 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-53eed06e-00eb-431e-86c9-d7c00589aa4f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 204 len: 0 microversion: 2.1 time: 0.372691 Oct 04 08:55:15.665963 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 220/449] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:55:15 2022] DELETE /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:55:15.680467 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:15.681805 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:15.688690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.689262 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.689799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.690745 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.691477 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.691985 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.726001 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:15.727048 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:15.733858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.734477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.735047 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.735752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:15.736269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:15.736865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:15.887402 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:15.898123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-602e21f9-3d7a-4107-bbc0-e16ceb5e89f7 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1514 microversion: 2.1 time: 0.222242 Oct 04 08:55:15.899263 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 230/450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:15 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:15.919262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:15.928239 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:15.929987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:15.931210 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fbca7503-78bd-4d6f-a65e-be862dac9b75 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.209677 Oct 04 08:55:15.931807 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 221/451] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:15 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:16.032538 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-4d55e65b-7a5d-40fb-a1da-2bfa3b0b7bbe req-3f9bcac5-0866-4511-9966-181d7a78a0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acaf703d-ba5c-4518-a5d9-afa1a34dcfd1", "name": "network-vif-plugged", "status": "completed", "tag": "e0969193-60ee-4fb7-ba1b-70b50bfb9b9d"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:16.042988 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-4d55e65b-7a5d-40fb-a1da-2bfa3b0b7bbe req-3f9bcac5-0866-4511-9966-181d7a78a0d1 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.043560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-4d55e65b-7a5d-40fb-a1da-2bfa3b0b7bbe req-3f9bcac5-0866-4511-9966-181d7a78a0d1 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.044059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-4d55e65b-7a5d-40fb-a1da-2bfa3b0b7bbe req-3f9bcac5-0866-4511-9966-181d7a78a0d1 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.055568 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-4d55e65b-7a5d-40fb-a1da-2bfa3b0b7bbe req-3f9bcac5-0866-4511-9966-181d7a78a0d1 service nova] Creating event network-vif-plugged:e0969193-60ee-4fb7-ba1b-70b50bfb9b9d for instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 on hv-cinder-85944 Oct 04 08:55:16.061263 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-4d55e65b-7a5d-40fb-a1da-2bfa3b0b7bbe req-3f9bcac5-0866-4511-9966-181d7a78a0d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 Oct 04 08:55:16.061965 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 231/452] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:16.922012 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:16.922681 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:16.929255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.929741 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.930193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.930918 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.931374 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.931799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.936695 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:16.958650 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:16.964794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:16.974435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.975277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.975866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:16.977628 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:16.980285 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:16.982369 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:17.155247 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:17.165370 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-68231734-1f2f-44c0-a5bb-d423c133b5cb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1514 microversion: 2.1 time: 0.247202 Oct 04 08:55:17.179440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 222/453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:16 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:17.189481 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-09e05d4c-f124-448d-bde5-6e99887be07c req-eefac731-6919-432c-b78e-f576a822f665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a4610c-eb87-46b5-bdb5-25c521d71a5d", "tag": "4016b744-a552-4b39-96d5-0dd5bd2f34c4"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:17.204787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:17.212416 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-09e05d4c-f124-448d-bde5-6e99887be07c req-eefac731-6919-432c-b78e-f576a822f665 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:17.213146 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-09e05d4c-f124-448d-bde5-6e99887be07c req-eefac731-6919-432c-b78e-f576a822f665 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:17.214105 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-09e05d4c-f124-448d-bde5-6e99887be07c req-eefac731-6919-432c-b78e-f576a822f665 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:17.225688 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:17.226960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-09e05d4c-f124-448d-bde5-6e99887be07c req-eefac731-6919-432c-b78e-f576a822f665 service nova] Creating event network-changed:4016b744-a552-4b39-96d5-0dd5bd2f34c4 for instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d on hv-cinder-85944 Oct 04 08:55:17.227465 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:17.230501 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-10fed1fc-23fc-49f8-92ef-49fc9e9fadde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.275190 Oct 04 08:55:17.238243 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 232/454] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:16 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:17.246109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-09e05d4c-f124-448d-bde5-6e99887be07c req-eefac731-6919-432c-b78e-f576a822f665 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065119 Oct 04 08:55:17.255697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 223/455] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:18.193029 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:18.193644 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:18.201493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.201987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.202458 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.203476 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.204536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.212578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.259446 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:18.260303 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:18.267904 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.268832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.269325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.270098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:18.270650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:18.271278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:18.436668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:18.445362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7e2a463e-a896-44e3-bff8-0b03a873b57b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1514 microversion: 2.1 time: 0.255978 Oct 04 08:55:18.446252 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 233/456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:18 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:18.478184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:18.488488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:18.490024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:18.492042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-955ec0d1-e86b-4853-a234-e4a09da115a4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.237921 Oct 04 08:55:18.492690 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 224/457] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:18 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:55:19.290083 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-f9453d2b-a6e8-47b0-9d6f-4e2bfbfc1700 req-3166ed70-9cbc-46d6-bbe3-5e1f86242f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1", "name": "network-vif-deleted", "tag": "602efdf9-2f61-45ea-b518-8b6d9821574a"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:19.307818 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f9453d2b-a6e8-47b0-9d6f-4e2bfbfc1700 req-3166ed70-9cbc-46d6-bbe3-5e1f86242f55 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.308658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f9453d2b-a6e8-47b0-9d6f-4e2bfbfc1700 req-3166ed70-9cbc-46d6-bbe3-5e1f86242f55 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.309306 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f9453d2b-a6e8-47b0-9d6f-4e2bfbfc1700 req-3166ed70-9cbc-46d6-bbe3-5e1f86242f55 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.322570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-f9453d2b-a6e8-47b0-9d6f-4e2bfbfc1700 req-3166ed70-9cbc-46d6-bbe3-5e1f86242f55 service nova] Creating event network-vif-deleted:602efdf9-2f61-45ea-b518-8b6d9821574a for instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 on hv-cinder-85944 Oct 04 08:55:19.327970 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-f9453d2b-a6e8-47b0-9d6f-4e2bfbfc1700 req-3166ed70-9cbc-46d6-bbe3-5e1f86242f55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041849 Oct 04 08:55:19.331467 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 234/458] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:19.470041 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:19.470802 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:19.477899 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.478375 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.478838 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.480175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.480676 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.481149 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.519397 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:19.520203 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:19.527675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.528166 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.528600 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.529297 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.529747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.530169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.551481 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.560233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a3a958a1-002d-41da-b25f-41799e138b03 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1303 microversion: 2.1 time: 0.094086 Oct 04 08:55:19.563466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 225/459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:19 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:19.680159 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.689653 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.691265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:19.692452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-93832b2b-95f0-4a2c-9b0f-cc183e4e3a73 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.177787 Oct 04 08:55:19.693009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 235/460] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:19 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:19.743808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1529661328"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:19.744367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:19.751150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.751629 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.752061 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.752745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:19.753192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:19.753613 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:19.884182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.network.security_group_api [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Adding security group 0d2468c3-ae27-4b10-b824-090462463668 to port 4016b744-a552-4b39-96d5-0dd5bd2f34c4 Oct 04 08:55:20.298848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1fb36fa6-d106-485d-b0ac-80d3a38e059f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "POST /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/action" status: 202 len: 0 microversion: 2.1 time: 0.558666 Oct 04 08:55:20.299777 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 226/461] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:55:19 2022] POST /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:55:20.309412 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:20.310021 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:20.320158 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.320651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.321089 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.321782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.322678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.323286 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.330575 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-6b011021-59e2-4915-b1bf-ff57f46c760f req-44bacf9b-0468-450e-b425-11f313a5a150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a4610c-eb87-46b5-bdb5-25c521d71a5d", "tag": "4016b744-a552-4b39-96d5-0dd5bd2f34c4"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:20.355393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-6b011021-59e2-4915-b1bf-ff57f46c760f req-44bacf9b-0468-450e-b425-11f313a5a150 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.355986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-6b011021-59e2-4915-b1bf-ff57f46c760f req-44bacf9b-0468-450e-b425-11f313a5a150 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.356421 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-6b011021-59e2-4915-b1bf-ff57f46c760f req-44bacf9b-0468-450e-b425-11f313a5a150 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.407529 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-6b011021-59e2-4915-b1bf-ff57f46c760f req-44bacf9b-0468-450e-b425-11f313a5a150 service nova] Creating event network-changed:4016b744-a552-4b39-96d5-0dd5bd2f34c4 for instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d on hv-cinder-85944 Oct 04 08:55:20.416005 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-6b011021-59e2-4915-b1bf-ff57f46c760f req-44bacf9b-0468-450e-b425-11f313a5a150 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089757 Oct 04 08:55:20.416664 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 227/462] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:20.563888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.575986 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-40bbd33a-faba-4e3c-b109-c490665b7809 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1760 microversion: 2.1 time: 0.271776 Oct 04 08:55:20.594474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 236/463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:20 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1760 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:20.594826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:20.594826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:20.600289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.600890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.601548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.602464 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.603072 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.603494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.638478 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.638987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.639379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.639853 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lazy-loading 'fault' on Instance uuid ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:55:20.689086 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.696971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6572661b-8f5c-4be1-8216-c530e39f218f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1308 microversion: 2.1 time: 0.116154 Oct 04 08:55:20.697540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 228/464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:20 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:20.726649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:20.728003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:20.735457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.736018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.736619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.737743 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:20.738278 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:20.738792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:20.880070 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.889323 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.891050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:20.892517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1ca75882-f584-4f56-9d93-a2009fc1c931 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1806 microversion: 2.20 time: 0.176240 Oct 04 08:55:20.901889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 237/465] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:20 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:21.721555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:21.722166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:21.728597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.729106 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.730353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:21.736013 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.736013 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.736013 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:21.765783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.766269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.766744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:21.767200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lazy-loading 'fault' on Instance uuid ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:55:21.808704 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:21.816483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-beb5127f-98cc-45fe-9b6f-ad5f64aeeecf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 200 len: 1308 microversion: 2.1 time: 0.098825 Oct 04 08:55:21.817041 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 229/466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:21 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:21.917907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:21.918480 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:21.925489 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.926097 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.926496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:21.927185 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:21.927632 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:21.928051 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:22.079009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:22.089654 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:22.091971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:22.093291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f3c4fc38-0723-421b-9b35-588e6cec9884 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1793 microversion: 2.20 time: 0.180137 Oct 04 08:55:22.101769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 238/467] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:55:21 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1793 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:55:22.839848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:22.840456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:22.846932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:22.847411 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:22.847841 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:22.848521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:22.848969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:22.849422 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:22.863103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] HTTP exception thrown: Instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 could not be found. Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Request method failure captured: Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 HTTP/1.1 Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_SHoFFQy6HUaKQoeb24dEdvGb_0kxOd_9mrgauu5lmPtT3Poc0942ZTGBw2w9ucDYviPeG97rysXW0fv23Zj6shDEPSjoxfoARejL-b5BCwBhkevQn3qY0x_lOe9jFAIzpsnBqZSwl3h4qhviKW8BePlxhzm-S1E-M_tfuj8rAzZsk Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: b1f2fb36dae5483ebc61c88336461b18 Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-VolumesSnapshotTestJSON-454171229 Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:55:22.864706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b1f2fb36dae5483ebc61c88336461b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b1f2fb36dae5483ebc61c88336461b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b1f2fb36dae5483ebc61c88336461b18", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b1f2fb36dae5483ebc61c88336461b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-VolumesSnapshotTestJSON-454171229 Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: b1f2fb36dae5483ebc61c88336461b18 Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-454171229 Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-VolumesSnapshotTestJSON-454171229-project Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 2677a4d76de24a729b87a211b49b965a Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-VolumesSnapshotTestJSON-454171229-project Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 could not be found. Oct 04 08:55:22.866217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1'} Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 could not be found. Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:55:22.867137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 could not be found. Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 could not be found. Oct 04 08:55:22.868710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:55:22.870734 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Returning 404 to user: Instance ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:55:22.870734 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-17fe948e-969b-4109-accc-ffb055151aac tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1" status: 404 len: 111 microversion: 2.1 time: 0.030066 Oct 04 08:55:22.870734 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 230/468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:22 2022] GET /compute/v2.1/servers/ec3a547a-09d2-4e5e-a8d4-f2f4090d8aa1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:55:23.109312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-057d9fdf-06fa-4390-aee5-0c6fcb2f296d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:23.115889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-057d9fdf-06fa-4390-aee5-0c6fcb2f296d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.116372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-057d9fdf-06fa-4390-aee5-0c6fcb2f296d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.116805 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-057d9fdf-06fa-4390-aee5-0c6fcb2f296d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.179678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-057d9fdf-06fa-4390-aee5-0c6fcb2f296d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Going to try to stop instance {{(pid=127548) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 08:55:23.385461 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-057d9fdf-06fa-4390-aee5-0c6fcb2f296d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/action" status: 202 len: 0 microversion: 2.1 time: 0.280615 Oct 04 08:55:23.386788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 239/469] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:55:23 2022] POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:55:23.394987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:23.395673 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:23.402925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.403412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.403886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.404599 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:23.405060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:23.405489 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:23.533246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:23.541349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-57e66ca6-b6d7-4378-b6f0-3ba403015837 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.150574 Oct 04 08:55:23.541923 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 231/470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:23 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:24.565804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:24.566452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:24.572496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:24.572976 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:24.573411 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:24.574094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:24.574576 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:24.575002 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:24.703468 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:24.711750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-10359ad6-9876-4333-b0c8-5a548b4ed06d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.150651 Oct 04 08:55:24.712310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 240/471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:24 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:25.735616 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:25.736232 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:25.742791 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:25.743271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:25.743707 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:25.744397 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:25.744851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:25.745381 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:25.875191 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:25.883661 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a73de1c7-83fa-4e8f-bc9d-e5f0a9ed0c3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.151909 Oct 04 08:55:25.884218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 232/472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:25 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:26.907067 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:26.907674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:26.914180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:26.914701 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:26.915138 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:26.915821 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:26.916275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:26.916699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:26.935054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:27.046746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:27.055016 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5dcf813f-8306-4ef1-ac78-d6032881cb24 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.151887 Oct 04 08:55:27.055587 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 241/473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:26 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:28.079679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:28.080408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:28.087138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:28.087609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:28.088047 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:28.088749 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:28.089212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:28.090125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:28.221785 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:28.230492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-10e55ac3-216a-4f39-8800-aefb441855b0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.154560 Oct 04 08:55:28.231094 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 233/474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:28 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:29.254947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:29.255582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:29.258733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=68 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:29.264611 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:29.265086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:29.265517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:29.266243 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:29.266793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:29.267223 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:29.403187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:29.411397 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8eefd0a5-aa5d-4f49-91d3-1e57e4f5c2d3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.160487 Oct 04 08:55:29.411958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 242/475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:29 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:30.434650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:30.435263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:30.437817 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:30.442318 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:30.442836 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:30.443274 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:30.443960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:30.444414 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:30.444840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:30.578843 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:30.587631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a646056c-9a76-4be1-a7a5-14e535ed8b4c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.156975 Oct 04 08:55:30.588194 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 234/476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:30 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:31.612035 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:31.612654 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:31.619104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:31.619590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:31.620028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:31.621385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:31.622382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:31.622839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:31.749702 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:31.758534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3db09978-da7e-41ca-8986-a6c4b72eaa52 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.150290 Oct 04 08:55:31.759123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 243/477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:31 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:32.782130 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:32.782773 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:32.789391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:32.789868 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:32.790304 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:32.791008 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:32.791456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:32.791879 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:32.919083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:32.927123 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1510abfc-15b1-42f5-ae04-5eb2f568bb94 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.149240 Oct 04 08:55:32.927711 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 235/478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:32 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:33.313394 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1480873337", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "networks": [{"uuid": "55fbb12a-1798-478e-a82a-501e9d9942f8"}]}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:33.375090 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] validate_networks() for [('55fbb12a-1798-478e-a82a-501e9d9942f8', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:55:33.725399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:55:33.725830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:55:33.726315 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:55:33.726795 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:55:33.727212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:55:33.736235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.740453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.740453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.740453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.740453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.740813 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.755796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Getting quotas for project b1f2fb36dae5483ebc61c88336461b18. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:55:33.760028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Getting quotas for user 2677a4d76de24a729b87a211b49b965a and project b1f2fb36dae5483ebc61c88336461b18. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:55:33.771733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:55:33.774022 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:55:33.892661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a4d41339-2165-4a71-93a4-6765f84ea370 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583999 Oct 04 08:55:33.893319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 244/479] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:55:33.905402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-56d54880-af3c-4c54-9f87-4b2f0c725468 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:33.906019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-56d54880-af3c-4c54-9f87-4b2f0c725468 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:33.951300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:33.951916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:33.959487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.959995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.960439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.961520 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:33.962268 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:33.962738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:33.970629 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-56d54880-af3c-4c54-9f87-4b2f0c725468 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:33.977747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-56d54880-af3c-4c54-9f87-4b2f0c725468 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1219 microversion: 2.1 time: 0.077230 Oct 04 08:55:33.978320 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 236/480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:33 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:34.100420 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:34.109393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8c8d620c-a4b8-4e7b-8b32-3d178b5af1ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.162606 Oct 04 08:55:34.110602 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 245/481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:33 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:35.002582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:35.003260 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:35.011090 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:35.012232 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:35.012672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.013360 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:35.013805 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:35.014256 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.076404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.084024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cebbc2ca-e890-4479-940f-b300661dd9fd tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1215 microversion: 2.1 time: 0.085631 Oct 04 08:55:35.084584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 237/482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:34 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:35.133343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:35.133945 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:35.140474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:35.140946 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:35.141410 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.142107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:35.143595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:35.143595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:35.275804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:35.285168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e1a50204-f825-4d63-9d15-afefdeee4588 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.156000 Oct 04 08:55:35.285935 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 246/483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:35 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:36.113736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:36.114347 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:36.121132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.121611 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.122069 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.122786 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.123250 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.123673 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.187466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:36.195514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e461abdd-ab6d-485d-81ac-fd2777318f79 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1271 microversion: 2.1 time: 0.085876 Oct 04 08:55:36.196334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 238/484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:36 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:36.309543 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:36.310504 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:36.320208 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.320698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.321314 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.322018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:36.322779 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:36.323102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:36.458660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:36.467446 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bb0fb52c-e124-40aa-a063-3197d132bf04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.161826 Oct 04 08:55:36.468023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 247/485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:36 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:37.220038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:37.221262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:37.229709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:37.230188 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:37.230663 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:37.231473 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:37.232475 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:37.232908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:37.366018 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:37.374519 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-827c648e-dc47-412b-8111-e95d42df2d90 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.158987 Oct 04 08:55:37.375097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 239/486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:37 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:37.491755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:37.494184 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:37.499692 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:37.500175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:37.500607 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:37.501290 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:37.501745 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:37.502168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:37.632438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:37.641751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-532f9013-65fe-47c2-8f15-f81000fbd296 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.153725 Oct 04 08:55:37.642492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 248/487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:37 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:38.104980 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-e77473f3-0ee4-412d-b7ce-347a3767cb66 req-9d666409-9a51-4fcc-8c1d-3c8ef406b2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73", "tag": "53cc50a8-9c2d-4945-9dfd-844648146770"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:38.116245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e77473f3-0ee4-412d-b7ce-347a3767cb66 req-9d666409-9a51-4fcc-8c1d-3c8ef406b2b8 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.118104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e77473f3-0ee4-412d-b7ce-347a3767cb66 req-9d666409-9a51-4fcc-8c1d-3c8ef406b2b8 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.118104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e77473f3-0ee4-412d-b7ce-347a3767cb66 req-9d666409-9a51-4fcc-8c1d-3c8ef406b2b8 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.129842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-e77473f3-0ee4-412d-b7ce-347a3767cb66 req-9d666409-9a51-4fcc-8c1d-3c8ef406b2b8 service nova] Creating event network-changed:53cc50a8-9c2d-4945-9dfd-844648146770 for instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 on hv-cinder-85944 Oct 04 08:55:38.136250 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-e77473f3-0ee4-412d-b7ce-347a3767cb66 req-9d666409-9a51-4fcc-8c1d-3c8ef406b2b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035182 Oct 04 08:55:38.136851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 240/488] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:38.399088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:38.399891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:38.406764 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.407332 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.407834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.408643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.409155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.409645 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.540066 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.548437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-16f437ed-476b-4914-a9f1-93b219f56baf tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.153204 Oct 04 08:55:38.549015 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 249/489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:38 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:38.665549 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:38.666164 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:38.672971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.673558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.673993 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.674702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:38.675150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:38.675572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:38.803426 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:38.812317 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8900f26a-1dfc-427e-8d8b-2be19307e8f5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.151167 Oct 04 08:55:38.812878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 241/490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:38 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:39.571335 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:39.571941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:39.578617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.581975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.581975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.581975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.581975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.582351 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.710649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.720990 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-925c28c6-e5dc-4481-a1bf-b6e07fec556e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.153442 Oct 04 08:55:39.721559 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 250/491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:39 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:39.836198 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:39.836811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:39.844116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.844603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.845045 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.845737 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:39.846192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:39.846650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:39.850748 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:39.979815 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:39.988839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-25d94650-3793-4d18-ae35-b9e40956526f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.156481 Oct 04 08:55:39.989413 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 242/492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:39 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:40.744231 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:40.744838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:40.752033 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:40.752504 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:40.752930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:40.753602 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:40.754047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:40.754494 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:40.881670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:40.890174 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-874b9774-11e8-40db-b118-f2414102cc61 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.149763 Oct 04 08:55:40.890783 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 251/493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:40 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:41.012549 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:41.013761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:41.020118 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:41.020601 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:41.021035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:41.021720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:41.022175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:41.022633 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:41.152861 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:41.161035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cd38de2b-fed6-48f3-a9de-f626cce05a1a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.152272 Oct 04 08:55:41.161602 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 243/494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:41 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:41.913872 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:41.914503 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:41.921059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:41.921543 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:41.921983 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:41.922899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:41.923127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:41.923548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.051203 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.058734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e6b95b0c-0e5e-4f06-bffc-5bd4b9263a0e tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.148766 Oct 04 08:55:42.059300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 252/495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:41 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:42.184371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:42.185564 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:42.192134 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.192615 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.193048 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.193735 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:42.194189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:42.194650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:42.327665 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:42.335824 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fbc8373b-ab3b-47f2-b416-9d9bcefaf608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.155543 Oct 04 08:55:42.336393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 244/496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:42 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:43.081894 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:43.082578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:43.089606 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.090088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.090554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.091925 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.092375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.092790 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.227158 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:43.235471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-050dc076-3fa0-4904-8fe7-888e8fcb8eb4 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.157349 Oct 04 08:55:43.236055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 253/497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:43 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:43.361827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:43.362367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:43.369440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.369920 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.370355 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.371103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:43.371551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:43.372607 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:43.522651 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:43.532189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c92c0e90-f66f-4c2a-b2b6-64e6226840cc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.174690 Oct 04 08:55:43.532790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 245/498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:43 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:44.249461 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-14926659-a32f-4d4c-b725-310c75b44a83 req-54408eb3-b09a-4228-b91b-23785cd8c3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73", "name": "network-vif-plugged", "status": "completed", "tag": "53cc50a8-9c2d-4945-9dfd-844648146770"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:44.255759 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:44.256424 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=6 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:44.260790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:44.262251 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:44.262363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-14926659-a32f-4d4c-b725-310c75b44a83 req-54408eb3-b09a-4228-b91b-23785cd8c3cb service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:44.262363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-14926659-a32f-4d4c-b725-310c75b44a83 req-54408eb3-b09a-4228-b91b-23785cd8c3cb service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:44.262363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-14926659-a32f-4d4c-b725-310c75b44a83 req-54408eb3-b09a-4228-b91b-23785cd8c3cb service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:44.265000 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:44.268617 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:44.269106 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:44.269545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:44.270235 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:44.270720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:44.271148 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:44.274111 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-14926659-a32f-4d4c-b725-310c75b44a83 req-54408eb3-b09a-4228-b91b-23785cd8c3cb service nova] Creating event network-vif-plugged:53cc50a8-9c2d-4945-9dfd-844648146770 for instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 on hv-cinder-85944 Oct 04 08:55:44.279836 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-14926659-a32f-4d4c-b725-310c75b44a83 req-54408eb3-b09a-4228-b91b-23785cd8c3cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 Oct 04 08:55:44.280618 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 254/499] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:55:44.412362 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.421358 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b879f084-f3b7-4ea3-b078-9cdb1a0440a8 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.164597 Oct 04 08:55:44.421961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 246/500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:44 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:44.557310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:44.558019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:44.566088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:44.568352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:44.568352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:44.568352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:44.568352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:44.568750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:44.701329 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:44.709760 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3f4dce9d-886f-40ec-8ba8-e1a8cd6056bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.156766 Oct 04 08:55:44.710329 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 255/501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:44 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:45.444733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:45.445340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:45.452532 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.453011 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.453440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.454218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.454692 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.455110 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.584740 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.593407 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-98b895e8-f939-47be-aaa0-465db9105435 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.152906 Oct 04 08:55:45.594021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 247/502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:45 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:45.734372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:45.735012 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:45.741370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.741848 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.742277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.742999 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:45.743433 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:45.743853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:45.870563 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:45.877806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-06a681bc-9505-4526-90b3-29713d8bf76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.147812 Oct 04 08:55:45.878371 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 256/503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:45 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:46.616941 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:46.617555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:46.624076 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.624557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.625028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.625713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.626166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.626615 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.755561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:46.763995 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-32a0084c-c213-46c4-b6b6-c9b4bd5c9694 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1319 microversion: 2.1 time: 0.150848 Oct 04 08:55:46.764558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 248/504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:46 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:46.902007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:46.902659 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:46.909406 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.909890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.910331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:46.911042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:46.911519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:46.911944 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.055483 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:47.064965 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-65850c0a-74c7-4096-b299-34f32df189f4 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.166525 Oct 04 08:55:47.065541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 257/505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:46 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:47.787659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:47.788270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:47.795348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.795843 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.796275 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.796954 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.797401 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.797819 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.925297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:47.933412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c79a78ab-bf76-4cdd-b902-dcea02af1d21 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1509 microversion: 2.1 time: 0.149744 Oct 04 08:55:47.933979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 249/506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:47 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:47.957035 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b7a238d-2d6c-4242-9ead-42c4dd14b838", "device": "/dev/sdb"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:47.959430 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:47.966748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.967230 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.967662 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:47.968342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:47.968795 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:47.969218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:48.088733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:48.089261 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:48.100684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:48.100684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:48.100684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:48.100684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:48.101016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:48.101016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:48.236729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:48.245488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-72f9efed-d441-445c-acf8-03ab9822cfa8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.160763 Oct 04 08:55:48.246111 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 250/507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:48 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:48.534941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:48.734143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-99fd05be-7485-4484-af57-cdf91a054163 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "POST /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780799 Oct 04 08:55:48.734801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 258/508] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:55:47 2022] POST /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:55:49.269397 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:49.270018 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:49.276492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:49.276971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:49.277409 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:49.278098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:49.279084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:49.279517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:49.412627 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:49.421653 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2d59d8a8-3e88-4c7c-a072-4187a3feff0d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.156213 Oct 04 08:55:49.422196 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 251/509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:49 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:50.445402 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:50.446100 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:50.452628 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.453104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.453542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.454228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.454713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.455134 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.590541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:50.599958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-597286f8-bf3b-4e83-a8c3-50f355b47228 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.159288 Oct 04 08:55:50.600515 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 259/510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:50 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:50.701127 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:50.704233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:50.710709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.711188 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.711620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.712310 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.712761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.713184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.932243 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-42d59d3f-6858-4534-b166-f7e77825b11e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "POST /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/action" status: 202 len: 0 microversion: 2.1 time: 0.234933 Oct 04 08:55:50.933380 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 252/511] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:55:50 2022] POST /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:55:50.940773 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:50.941413 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:50.947560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.948046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.948720 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:50.949161 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:50.949615 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:50.950040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.094072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.102559 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f36e9271-8ba4-4c9d-aad9-725985fb77f9 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1752 microversion: 2.1 time: 0.165498 Oct 04 08:55:51.103139 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 260/512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:50 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:51.624116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:51.624662 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:51.630699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:51.631186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:51.631666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.632350 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:51.632802 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:51.633489 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:51.767669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:51.775911 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-23c253b2-ce5d-4a6d-907d-53e87baee380 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.156179 Oct 04 08:55:51.776797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 253/513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:51 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:52.126647 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:52.127254 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:52.133854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:52.134329 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:52.134792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:52.135481 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:52.135936 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:52.136361 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:52.282366 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:52.290638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-165fba3d-5cee-4e24-9d91-b68d00d5b497 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.168615 Oct 04 08:55:52.291211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 261/514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:52 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:52.799620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:52.800224 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:52.806606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:52.807085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:52.807512 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:52.808190 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:52.808638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:52.809056 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:52.933618 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:52.942267 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b2e8740d-01bd-4aae-bd39-ea5a238a7f28 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.146805 Oct 04 08:55:52.942849 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 254/515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:52 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:53.319756 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:53.320388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:53.326569 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:53.327086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:53.327545 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:53.328228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:53.328676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:53.329102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:53.471673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:53.479850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1af518b6-bf47-4670-9ca5-70bbe904c2aa tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.164018 Oct 04 08:55:53.480409 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 262/516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:53 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:53.966733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:53.967327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:53.973662 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:53.974138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:53.974615 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:53.975311 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:53.975747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:53.976163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.115498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:54.123810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-be59ad68-1ac9-4d73-8a0e-c5b201be4399 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1722 microversion: 2.1 time: 0.161022 Oct 04 08:55:54.124991 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 255/517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:53 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:54.503660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:54.504268 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:54.511229 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.511709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.512141 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.512815 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:54.513261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:54.513677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:54.653891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:54.662177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-32bd714c-e45e-49c1-99b4-83a32818ba2a tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.162356 Oct 04 08:55:54.662755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 263/518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:54 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:55.150682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:55.151918 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:55.158201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.158727 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.159168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.159861 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.160314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.160751 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.291101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:55.299456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4b09f536-3579-4408-880e-9468fa31304d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1699 microversion: 2.1 time: 0.152532 Oct 04 08:55:55.300019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 256/519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:55 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:55.322011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-907fc5bc-b545-4ac8-b911-c16d832785e5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:55:55.328802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-907fc5bc-b545-4ac8-b911-c16d832785e5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.329275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-907fc5bc-b545-4ac8-b911-c16d832785e5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.329700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-907fc5bc-b545-4ac8-b911-c16d832785e5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.354156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-907fc5bc-b545-4ac8-b911-c16d832785e5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Going to try to start instance {{(pid=127548) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 08:55:55.531939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-907fc5bc-b545-4ac8-b911-c16d832785e5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/action" status: 202 len: 0 microversion: 2.1 time: 0.213429 Oct 04 08:55:55.532629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 264/520] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:55:55 2022] POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:55:55.541003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:55.541703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:55.548522 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.549084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.549558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.550246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.550726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.551151 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.689023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:55.690276 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:55.692666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:55.696505 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:55.697295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.697782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.698225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.698950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:55.699408 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:55.699832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:55.701572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-31ef2ca4-da9e-44e3-a54e-94e1a1a0bc4d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1708 microversion: 2.1 time: 0.164376 Oct 04 08:55:55.702264 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 257/521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:55 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:56.036785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:56.044844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-72aa3f57-c08e-4b4b-bf96-335d47c23a50 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.363430 Oct 04 08:55:56.045401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 265/522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:55 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:55:56.725111 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:56.725736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:56.734168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:56.734794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:56.735433 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:56.736037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:56.736494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:56.736920 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:56.866594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:56.875598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-63255d55-3497-4177-8f6d-73ad15cf5786 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1708 microversion: 2.1 time: 0.154340 Oct 04 08:55:56.876086 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 258/523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:56 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:57.068430 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:57.069109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:57.075623 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.076104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.076542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.077316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.077773 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.078200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.219651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:57.227774 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e0b83328-0c3f-477b-87be-10bba0242915 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.163254 Oct 04 08:55:57.242432 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 266/524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:57 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:57.899324 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:57.899833 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:57.906960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.907441 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.907878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:57.908569 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:57.909019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:57.909443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:58.034754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:58.042888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-374b8db5-bc60-4c90-9751-09b28ec21d3d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1712 microversion: 2.1 time: 0.147468 Oct 04 08:55:58.043443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 259/525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:57 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:58.251805 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:58.252411 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:58.259058 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:58.259536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:58.259965 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:58.260642 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:58.261173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:58.261601 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:58.405977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:58.414165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9f6acaac-41c4-482c-b5a5-9c69f0630078 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.166769 Oct 04 08:55:58.414770 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 267/526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:58 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:55:59.438858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:55:59.439494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:55:59.445926 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.446418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.446865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.447576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:55:59.448034 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:55:59.448453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:55:59.588546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:55:59.597119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-3618a006-fe17-4bb5-8375-8af2be0e7397 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.162618 Oct 04 08:55:59.597683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 260/527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:55:59 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:00.620659 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:00.621263 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:00.623687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:00.629115 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:00.630629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:00.630629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:00.630826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:00.631145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:00.631564 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:00.782699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:00.790889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-275856c1-4cbe-4ba6-9f66-e357dc58e607 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.174076 Oct 04 08:56:00.791448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 268/528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:00 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:01.814712 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:01.815424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:01.822300 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:01.822822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:01.823262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:01.823959 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:01.824446 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:01.824872 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:01.968665 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:01.976855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c6599c61-373a-4b6c-9a08-6b65c0b971b2 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.166638 Oct 04 08:56:01.977417 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 261/529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:01 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:03.002014 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:03.002653 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:03.009358 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.009833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.010265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.010964 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:03.011415 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:03.011830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:03.150150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:03.158479 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-cbe34afb-c390-4063-a269-08517ae40921 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.161331 Oct 04 08:56:03.159047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 269/530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:02 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:04.181835 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:04.182470 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:04.184775 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=58 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:04.190136 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.190643 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.191077 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.191761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:04.192212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:04.192634 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:04.338591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:04.346838 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-dd1b1148-fa71-4944-a207-d7fada6933e4 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.168799 Oct 04 08:56:04.347399 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 262/531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:04 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:05.372521 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:05.373133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:05.379907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:05.380423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:05.380862 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:05.381553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:05.382007 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:05.382455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:05.521820 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:05.529872 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-133ba4c9-f1c8-4509-b7d3-860a73a5511b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.161165 Oct 04 08:56:05.530447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 270/532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:05 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:06.553900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:06.554582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:06.562084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:06.562718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:06.563161 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:06.563858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:06.564314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:06.564829 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:06.689558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14538882-3782-4edb-b107-59871e135126"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:06.692980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:06.699539 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:06.700107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:06.700619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:06.701396 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:06.702101 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:06.702675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:06.716499 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:06.726527 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-de6babfa-356c-43d5-a84e-d7f1e8c415b6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.176511 Oct 04 08:56:06.730880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 263/533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:06 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:07.190445 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:07.190901 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:07.196917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.197394 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.198474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.199169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.199623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.200045 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.226055 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-77a5a130-a3ef-4f6e-a54d-909618afab97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5/ips" status: 200 len: 149 microversion: 2.1 time: 0.040023 Oct 04 08:56:07.226864 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 264/534] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:56:07 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:56:07.239298 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1761e0ed-2f94-44e8-974c-3e6fe4be37c0"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:07.242334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:07.247644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.248125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.248557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.249246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.250239 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.250760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.338696 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Invalid volume: volume 1761e0ed-2f94-44e8-974c-3e6fe4be37c0 is already attached to instances: 1a71a25f-8f53-4c71-8f61-9687de80f727 Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: POST /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5/os-volume_attachments HTTP/1.1 Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 74 Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:56:07.340539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {"volumeAttachment": {"volumeId": "1761e0ed-2f94-44e8-974c-3e6fe4be37c0"}} Oct 04 08:56:07.342092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Invalid volume: volume 1761e0ed-2f94-44e8-974c-3e6fe4be37c0 is already attached to instances: 1a71a25f-8f53-4c71-8f61-9687de80f727 Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'server_id': 'e6871eef-a47d-4c71-b1c8-4dc6aee127e5', 'body': {'volumeAttachment': {'volumeId': '1761e0ed-2f94-44e8-974c-3e6fe4be37c0'}}} Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1761e0ed-2f94-44e8-974c-3e6fe4be37c0 is already attached to instances: 1a71a25f-8f53-4c71-8f61-9687de80f727 Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:07.342938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1761e0ed-2f94-44e8-974c-3e6fe4be37c0 is already attached to instances: 1a71a25f-8f53-4c71-8f61-9687de80f727 Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:07.344197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:07.345497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:07.345497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:07.345497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:07.345497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1761e0ed-2f94-44e8-974c-3e6fe4be37c0 is already attached to instances: 1a71a25f-8f53-4c71-8f61-9687de80f727 Oct 04 08:56:07.345497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:07.345497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 400 to user: Invalid volume: volume 1761e0ed-2f94-44e8-974c-3e6fe4be37c0 is already attached to instances: 1a71a25f-8f53-4c71-8f61-9687de80f727 {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:07.345497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-89e76b4a-1e06-444a-92aa-acb794b5bfa9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107711 Oct 04 08:56:07.345497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 265/535] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:56:07 2022] POST /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 08:56:07.350943 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:07.351436 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:07.357406 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.357883 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.358313 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.359094 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.359545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.360060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.387436 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:56:07.481162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e7a54e56-4b22-4c81-bcf8-3333d59a65e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795743 Oct 04 08:56:07.481779 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 271/536] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:56:06 2022] POST /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:56:07.712952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4a066954-6ece-4681-8e7f-5728d5ba150f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 204 len: 0 microversion: 2.1 time: 0.365335 Oct 04 08:56:07.713496 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 266/537] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:07 2022] DELETE /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:56:07.722524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:07.723227 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:07.729398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.729874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.730311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.731011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.731460 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.731877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.752802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:07.753134 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:07.753851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:07.760071 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.760558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.760992 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.761686 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:07.762140 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:07.762595 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:07.939235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:07.957066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:07.964106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4bec47bb-7b35-4297-af4f-ca63c05c02a2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1682 microversion: 2.1 time: 0.242745 Oct 04 08:56:07.964106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 272/538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:07 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:07.968049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e85859b4-ee2f-482f-8738-a7a97d2e427d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.219457 Oct 04 08:56:07.982480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 267/539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:07 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:08.990682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:08.991292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:08.992804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:08.993413 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:08.997744 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:08.998224 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:08.998691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:08.999383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:08.999873 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.000364 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.000659 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.000843 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.001272 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.001957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.002429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.002844 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.197384 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:09.206024 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bbab19ab-fb29-4680-8e2d-b641aa9cc65f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1682 microversion: 2.1 time: 0.219407 Oct 04 08:56:09.206621 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 273/540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:08 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:09.212039 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:09.220008 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bd637575-b9a2-432a-9561-1ef9f06d9fef tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.230990 Oct 04 08:56:09.220560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 268/541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:08 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:09.841078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:09.841569 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:09.847577 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.848069 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.848506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.849185 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:09.849638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:09.850060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:09.943760 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lazy-loading 'services' on Instance uuid e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:10.140341 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1643b8a0-c61c-4b7e-bc85-62d47ac844c5 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73/os-volume_attachments/5b7a238d-2d6c-4242-9ead-42c4dd14b838" status: 202 len: 0 microversion: 2.1 time: 0.302882 Oct 04 08:56:10.141186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 274/542] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:56:09 2022] DELETE /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73/os-volume_attachments/5b7a238d-2d6c-4242-9ead-42c4dd14b838 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:56:10.230240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:10.230939 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:10.238056 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.238587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.239021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.239717 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.240173 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.240601 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.244619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:10.245353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:10.251933 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.253401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.253401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.253618 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:10.253972 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:10.254396 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:10.483231 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:10.493638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6842e938-484a-4c90-a09c-d3007a51af65 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1682 microversion: 2.1 time: 0.267103 Oct 04 08:56:10.494229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 269/543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:10 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:10.520200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:10.529941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bc75e8a8-e106-4fc1-80d9-599266e365fd tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.289379 Oct 04 08:56:10.530577 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 275/544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:10 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:11.516847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-05c5a483-246e-4172-bb1f-0ae0d584a4d7 req-0065612a-251c-4dc9-8aed-9d5ece0db413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6871eef-a47d-4c71-b1c8-4dc6aee127e5", "name": "network-vif-deleted", "tag": "e5a9fd37-19a7-4033-ac7c-1d59710ef898"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:11.520176 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:11.520806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:11.526937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-05c5a483-246e-4172-bb1f-0ae0d584a4d7 req-0065612a-251c-4dc9-8aed-9d5ece0db413 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.527407 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-05c5a483-246e-4172-bb1f-0ae0d584a4d7 req-0065612a-251c-4dc9-8aed-9d5ece0db413 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.527924 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-05c5a483-246e-4172-bb1f-0ae0d584a4d7 req-0065612a-251c-4dc9-8aed-9d5ece0db413 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.531669 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.539703 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.539703 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.539703 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.539703 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.540185 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.542285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-05c5a483-246e-4172-bb1f-0ae0d584a4d7 req-0065612a-251c-4dc9-8aed-9d5ece0db413 service nova] Creating event network-vif-deleted:e5a9fd37-19a7-4033-ac7c-1d59710ef898 for instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 on hv-cinder-85944 Oct 04 08:56:11.547754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-05c5a483-246e-4172-bb1f-0ae0d584a4d7 req-0065612a-251c-4dc9-8aed-9d5ece0db413 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035505 Oct 04 08:56:11.551968 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 270/545] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:11.557149 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:11.558117 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:11.565357 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.565842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.566275 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.567000 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:11.567451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:11.567875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:11.608726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:11.617814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5ca337eb-78dd-4422-8bc2-faf42ad2efcb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1614 microversion: 2.1 time: 0.102029 Oct 04 08:56:11.618792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 276/546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:11 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:11.751847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:11.761478 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-54c153ec-2249-423b-a75e-376aac89d3b0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.208263 Oct 04 08:56:11.762386 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 271/547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:11 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:12.645908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:12.646584 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:12.653150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.653631 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.654063 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.654782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.655229 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.655650 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.689516 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.690004 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.690510 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.690968 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid e6871eef-a47d-4c71-b1c8-4dc6aee127e5 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:12.731647 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:12.740715 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2bb8a7a8-ed3a-4004-b0ad-67e851817a97 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 200 len: 1332 microversion: 2.1 time: 0.098741 Oct 04 08:56:12.741283 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 277/548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:12 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:12.785607 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:12.786315 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:12.793068 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.793577 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.794008 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.794764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:12.795214 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:12.795636 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:12.962745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:12.973003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-023da7b7-7b1b-41f6-a0a2-400f6236f66d tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1757 microversion: 2.1 time: 0.191910 Oct 04 08:56:12.973587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 272/549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:12 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:13.766661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:13.767489 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:13.774292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:13.774897 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:13.775431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:13.776202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:13.776661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:13.777084 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:13.792301 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 HTTP/1.1 Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:56:13.795987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:56:13.797302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'e6871eef-a47d-4c71-b1c8-4dc6aee127e5'} Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:13.797994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:56:13.799145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:13.800169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:13.800169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2ab7ac0d-1144-451e-bb12-64ffb0d0b67a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 404 len: 111 microversion: 2.1 time: 0.034901 Oct 04 08:56:13.800169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 278/550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:13 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:13.804416 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9cdc532a-91fc-4aa2-a8aa-6313b857feb3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '.version_select at 0x7f6f1a739040>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:13.884450 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9cdc532a-91fc-4aa2-a8aa-6313b857feb3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113257061" status: 202 len: 0 microversion: 2.1 time: 0.083788 Oct 04 08:56:13.885202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 273/551] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 4 08:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113257061 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:56:13.996677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:13.997233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:14.003802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:14.016072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:14.016072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:14.016072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:14.016072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:14.016520 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:14.166728 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:14.174933 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-09fa275f-1ce6-4cf0-b75a-5fd7edc33a53 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1760 microversion: 2.1 time: 0.182202 Oct 04 08:56:14.175506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 279/552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:13 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:14.703103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:14.703673 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:14.710485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:14.710973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:14.711407 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:14.712094 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:14.712547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:14.712972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:14.831176 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:14.835350 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'services' on Instance uuid 1a71a25f-8f53-4c71-8f61-9687de80f727 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:15.071833 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4e42152b-00ae-4361-9f56-2aa960e0b993 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments/1761e0ed-2f94-44e8-974c-3e6fe4be37c0" status: 202 len: 0 microversion: 2.1 time: 0.372566 Oct 04 08:56:15.072416 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 274/553] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:56:14 2022] DELETE /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments/1761e0ed-2f94-44e8-974c-3e6fe4be37c0 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:56:15.081342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:15.083748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:15.089907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:15.090387 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:15.092050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:15.092050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:15.092050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:15.092383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:15.126897 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c2f80c90-3afd-40e6-aa97-348ade3eed5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050004 Oct 04 08:56:15.127463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 280/554] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:15 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:16.142078 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:16.144417 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:16.151066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:16.151545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:16.151973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:16.152654 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:16.153103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:16.153517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:16.184052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0ee67b7b-7dde-49e5-b4a6-7b532f06468b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047093 Oct 04 08:56:16.184642 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 275/555] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:16 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:17.196549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:17.198758 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:17.205235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:17.205747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:17.206183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:17.206973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:17.207452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:17.207874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:17.238369 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-51777bb3-b009-407d-844c-46911d8d3a92 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Oct 04 08:56:17.238958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 281/556] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:17 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:18.237103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:18.239304 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:18.245743 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.246228 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.246699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.247389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.247837 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.248259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.250784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:18.252921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:18.259460 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.259942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.260373 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.261060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.261507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.261925 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.275323 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lazy-loading 'flavor' on Instance uuid 836bad03-671e-48e3-8931-55435b0139d5 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:18.291998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-aa744c21-a070-4386-be54-a4c0c4b11fb6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Oct 04 08:56:18.292563 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 282/557] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:18 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:56:18.640768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c064523a-0803-41a9-bd8f-a4f6df513dc6 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/action" status: 200 len: 32 microversion: 2.1 time: 0.407792 Oct 04 08:56:18.641402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 276/558] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:56:18 2022] POST /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:56:18.651054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:18.651640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:18.658437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.658927 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.659352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.660045 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.660496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.660921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.710701 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:18.711305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:18.717389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.717874 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.718314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.719735 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:18.720003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:18.720435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:18.747434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:56:18.796408 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:18.805081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e16bc30c-9ab6-4ba4-86d5-9fb9fe6c9cf4 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.157975 Oct 04 08:56:18.805637 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 283/559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:18 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:19.049352 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-29909d6e-7f96-4cab-b3cd-655b4e75777b tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 204 len: 0 microversion: 2.1 time: 0.342498 Oct 04 08:56:19.050054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 277/560] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:18 2022] DELETE /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:56:19.060121 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:19.061042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:19.068963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.069720 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.070229 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.071029 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.071693 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.072193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.203500 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:19.211261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9c4ae519-1f78-4f5a-81ad-969e3c345dcb tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1515 microversion: 2.1 time: 0.155079 Oct 04 08:56:19.211827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 284/561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:19 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:19.308660 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:19.308660 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:19.313339 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.313823 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.314260 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.314970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.315422 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.315844 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.345914 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8d9db921-f4b1-48d7-bc5b-b7502d82d15d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Oct 04 08:56:19.346502 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 278/562] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:19 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:19.828571 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:19.829675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:19.836173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.836657 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.837092 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.837777 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:19.838233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:19.838687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:19.977063 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:19.979264 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-38e57735-bea3-4692-a97d-fac97e48ff12 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.154509 Oct 04 08:56:19.979839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 285/563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:19 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:20.235299 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:20.236587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:20.242575 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.243063 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.243478 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.244151 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.244597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.245016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.358595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:20.360979 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:20.366902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.367441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.367908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.368634 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:20.369088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:20.369514 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:20.377458 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:20.385598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-37215382-4a1f-4466-b8f2-7057638bc38f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1515 microversion: 2.1 time: 0.154199 Oct 04 08:56:20.386160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 279/564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:20 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:20.404393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e994fee7-9725-4a6e-95e6-986f19e7d5cb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049830 Oct 04 08:56:20.404939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 286/565] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:20 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:56:21.004418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.005068 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.011745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.012452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.012898 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.013604 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.014705 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.015426 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.150240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:21.158525 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-709545b8-c9f2-4ea9-8644-b348cc6b9e3e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.159162 Oct 04 08:56:21.174429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 280/566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:20 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:21.410510 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.411293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.417104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.418033 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.421932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.421932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.421932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.422187 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.422265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.422265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.427870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.428441 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.428950 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.429731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.430663 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.430905 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.485246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a8b30f31-efd0-4ff8-8c59-0ebb9046914f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072089 Oct 04 08:56:21.485817 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 281/567] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:56:21 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 08:56:21.491001 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.491504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.502542 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.503681 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.503977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.504678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.505125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.505541 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.551226 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fbf61223-26dd-4464-8e48-ee1cf004bd76 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments/283bb40c-d2ed-4cc3-9e1e-177b492ff431" status: 200 len: 194 microversion: 2.20 time: 0.057775 Oct 04 08:56:21.551226 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 282/568] 10.222.0.27 () {60 vars in 1454 bytes} [Tue Oct 4 08:56:21 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments/283bb40c-d2ed-4cc3-9e1e-177b492ff431 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:56:21.575956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.579782 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.585245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.585990 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.586521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.587437 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.588252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.588401 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.602794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:21.612161 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b28ca176-bfd8-4ae8-b100-0a4ff9f71ec9 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1515 microversion: 2.1 time: 0.205681 Oct 04 08:56:21.616297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:56:21.627167 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 287/569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:21 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:21.638345 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.638873 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.645395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.646125 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.646603 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.647295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.647750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.648172 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.739241 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:21.743192 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lazy-loading 'services' on Instance uuid acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:21.917073 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-536d6dc1-073f-45ba-abaa-e5919ddfb798 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 204 len: 0 microversion: 2.1 time: 0.345510 Oct 04 08:56:21.917715 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 283/570] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:56:21 2022] DELETE /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:56:21.922692 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-0a6f38e2-2d07-453a-b407-4de34ff6ad91 req-70c2b435-09dd-4219-98a9-77b98491bfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73", "name": "network-vif-deleted", "tag": "53cc50a8-9c2d-4945-9dfd-844648146770"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:21.932418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-0a6f38e2-2d07-453a-b407-4de34ff6ad91 req-70c2b435-09dd-4219-98a9-77b98491bfe8 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.932958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-0a6f38e2-2d07-453a-b407-4de34ff6ad91 req-70c2b435-09dd-4219-98a9-77b98491bfe8 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.933316 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-0a6f38e2-2d07-453a-b407-4de34ff6ad91 req-70c2b435-09dd-4219-98a9-77b98491bfe8 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.944702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-0a6f38e2-2d07-453a-b407-4de34ff6ad91 req-70c2b435-09dd-4219-98a9-77b98491bfe8 service nova] Creating event network-vif-deleted:53cc50a8-9c2d-4945-9dfd-844648146770 for instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 on hv-cinder-85944 Oct 04 08:56:21.949404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-0a6f38e2-2d07-453a-b407-4de34ff6ad91 req-70c2b435-09dd-4219-98a9-77b98491bfe8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030434 Oct 04 08:56:21.949988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 284/571] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:21.956764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:21.957454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:21.963558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.964042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.964508 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:21.965190 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:21.965639 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:21.966064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.004965 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-833d4e52-0a83-4704-903f-fd455ad81e1c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments/283bb40c-d2ed-4cc3-9e1e-177b492ff431" status: 202 len: 0 microversion: 2.20 time: 0.370724 Oct 04 08:56:22.005598 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 288/572] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Oct 4 08:56:21 2022] DELETE /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments/283bb40c-d2ed-4cc3-9e1e-177b492ff431 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:56:22.014794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:22.017124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:22.023718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.024212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.024689 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.025386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.026012 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.026467 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.058380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c9463af1-b35d-412e-98b5-ee0047a736d8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047835 Oct 04 08:56:22.059018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 289/573] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 4 08:56:22 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 08:56:22.099439 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:22.107222 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6bce5b72-711c-4d0f-a4f8-a57dad16c310 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1683 microversion: 2.1 time: 0.155192 Oct 04 08:56:22.107774 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 285/574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:21 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:22.182899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:22.183434 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:22.189637 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.190127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.191138 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.191834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.192286 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.192711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.320018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:22.328811 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-17006241-3ed0-4f27-b36e-fa13c414a2e8 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.149844 Oct 04 08:56:22.333519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 290/575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:22 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:22.637483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:22.638093 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:22.644501 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.644977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.645408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.646089 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:22.646566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:22.646986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:22.651039 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:22.709931 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:22.717967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cff79a07-da24-4614-b528-135f12ea500f tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1304 microversion: 2.1 time: 0.084628 Oct 04 08:56:22.718572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 286/576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:22 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:23.071782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:23.074391 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:23.081942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.082441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.082882 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.083562 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.084013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.084733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.113948 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bcb08ebb-05fd-4568-b424-31f47ef823be tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046091 Oct 04 08:56:23.114521 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 291/577] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 4 08:56:23 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:56:23.133210 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:23.134090 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:23.140417 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.140897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.141333 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.142023 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.142508 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.142936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.267952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:23.275806 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fd84c9bb-b199-45f5-bbaf-b38947414e58 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1683 microversion: 2.1 time: 0.146418 Oct 04 08:56:23.276363 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 287/578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:23 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:23.352837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:23.353449 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:23.359617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.360261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.360711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.361415 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.361856 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.362848 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.496325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:23.505362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5b109851-d200-4b52-b91c-586acf1ce05e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.156463 Oct 04 08:56:23.505935 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 292/579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:23 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:23.741747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:23.742361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:23.748785 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.749306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.749741 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.750451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.750905 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.751334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.783244 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:23.783714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:23.784148 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:23.784590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lazy-loading 'fault' on Instance uuid e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:23.826337 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2677a4d76de24a729b87a211b49b965a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2fb36dae5483ebc61c88336461b18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:23.836133 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f7f8ab8c-7eb9-42aa-908d-db0121a3df56 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 200 len: 1309 microversion: 2.1 time: 0.097385 Oct 04 08:56:23.836133 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 288/580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:23 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:24.127199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:24.131141 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:24.140635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.141325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.142006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.142962 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.144105 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.144885 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.182470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b585537a-5b9b-47b9-b8b6-c9cd91de6768 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059144 Oct 04 08:56:24.183270 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 293/581] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 4 08:56:24 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:56:24.303575 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:24.304683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:24.313975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.315298 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.315932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.316884 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.318001 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.318743 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.333708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-8475077e-57f3-4907-988f-d5e73231ea56 req-0c4b71bd-06f5-47ab-88aa-d2757933d436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a71a25f-8f53-4c71-8f61-9687de80f727", "name": "network-vif-unplugged", "status": "completed", "tag": "6b040ace-0eaf-4833-81ba-09cdfc978084"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:24.344416 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8475077e-57f3-4907-988f-d5e73231ea56 req-0c4b71bd-06f5-47ab-88aa-d2757933d436 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.344823 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8475077e-57f3-4907-988f-d5e73231ea56 req-0c4b71bd-06f5-47ab-88aa-d2757933d436 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.345248 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8475077e-57f3-4907-988f-d5e73231ea56 req-0c4b71bd-06f5-47ab-88aa-d2757933d436 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.359948 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-8475077e-57f3-4907-988f-d5e73231ea56 req-0c4b71bd-06f5-47ab-88aa-d2757933d436 service nova] Creating event network-vif-unplugged:6b040ace-0eaf-4833-81ba-09cdfc978084 for instance 1a71a25f-8f53-4c71-8f61-9687de80f727 on hv-cinder-85944 Oct 04 08:56:24.366291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-8475077e-57f3-4907-988f-d5e73231ea56 req-0c4b71bd-06f5-47ab-88aa-d2757933d436 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037460 Oct 04 08:56:24.367585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 294/582] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:56:24.463943 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:24.472451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a49d3447-79e3-41e3-b314-6226f00f9460 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1683 microversion: 2.1 time: 0.177041 Oct 04 08:56:24.473651 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 289/583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:24 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:24.530217 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:24.531096 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:24.537527 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.538176 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.538643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.539379 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.539831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.540253 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.686863 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:24.693783 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-97493a74-b06a-46db-b535-0efac74c3d9e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.168343 Oct 04 08:56:24.694354 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 295/584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:24 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:24.858790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:24.859408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] [instance: e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:24.866486 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.867220 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.867662 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.868367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.868820 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.869250 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.888937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] HTTP exception thrown: Instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 could not be found. Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Request method failure captured: Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 HTTP/1.1 Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_SHoFFQy6HUaKQoeb24dEdvGb_0kxOd_9mrgauu5lmPtT3Poc0942ZTGBw2w9ucDYviPeG97rysXW0fv23Zj6shDEPSjoxfoARejL-b5BCwBhkevQn3qY0x_lOe9jFAIzpsnBqZSwl3h4qhviKW8BePlxhzm-S1E-M_tfuj8rAzZsk Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: b1f2fb36dae5483ebc61c88336461b18 Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-VolumesSnapshotTestJSON-454171229 Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:56:24.890666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b1f2fb36dae5483ebc61c88336461b18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b1f2fb36dae5483ebc61c88336461b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b1f2fb36dae5483ebc61c88336461b18", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b1f2fb36dae5483ebc61c88336461b18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-VolumesSnapshotTestJSON-454171229 Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: b1f2fb36dae5483ebc61c88336461b18 Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-454171229 Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-VolumesSnapshotTestJSON-454171229-project Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 2677a4d76de24a729b87a211b49b965a Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-VolumesSnapshotTestJSON-454171229-project Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 could not be found. Oct 04 08:56:24.891958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73'} Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 could not be found. Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:24.892650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 could not be found. Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 could not be found. Oct 04 08:56:24.894043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:24.902666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] Returning 404 to user: Instance e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:24.902666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9ca7e615-2d2d-4c96-82e9-28b8197e0614 tempest-VolumesSnapshotTestJSON-454171229 tempest-VolumesSnapshotTestJSON-454171229-project] 10.222.0.27 "GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73" status: 404 len: 111 microversion: 2.1 time: 0.037347 Oct 04 08:56:24.902666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 290/585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:24 2022] GET /compute/v2.1/servers/e99e2f0f-cf1a-40cd-b4c9-5e19ad928a73 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:24.933134 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-ca3c3238-39db-4201-8de5-10b9422c8e17 req-6eca339e-44cf-42d2-8b63-04376e09b51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a71a25f-8f53-4c71-8f61-9687de80f727", "name": "network-vif-deleted", "tag": "6b040ace-0eaf-4833-81ba-09cdfc978084"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:24.943814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ca3c3238-39db-4201-8de5-10b9422c8e17 req-6eca339e-44cf-42d2-8b63-04376e09b51f service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:24.944288 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ca3c3238-39db-4201-8de5-10b9422c8e17 req-6eca339e-44cf-42d2-8b63-04376e09b51f service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:24.944785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ca3c3238-39db-4201-8de5-10b9422c8e17 req-6eca339e-44cf-42d2-8b63-04376e09b51f service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:24.956433 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-ca3c3238-39db-4201-8de5-10b9422c8e17 req-6eca339e-44cf-42d2-8b63-04376e09b51f service nova] Creating event network-vif-deleted:6b040ace-0eaf-4833-81ba-09cdfc978084 for instance 1a71a25f-8f53-4c71-8f61-9687de80f727 on hv-cinder-85944 Oct 04 08:56:24.962010 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-ca3c3238-39db-4201-8de5-10b9422c8e17 req-6eca339e-44cf-42d2-8b63-04376e09b51f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032401 Oct 04 08:56:24.965474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 296/586] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:25.196031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:25.198359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:25.205457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.205957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.207312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.207936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.209052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.209487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.243551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f56d0c7a-a077-43b9-9585-06bc3ed314ac tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052043 Oct 04 08:56:25.244566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 291/587] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 4 08:56:25 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:25.314968 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:25.316249 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:25.322577 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.323102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.323546 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.324242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.324860 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.325493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.351972 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:56:25.498688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:25.499621 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:25.506869 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.507480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.508158 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.509836 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.510429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.510965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.550929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.550929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.550929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.550929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid 1a71a25f-8f53-4c71-8f61-9687de80f727 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:25.616037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.625652 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1b3ca57e-ff55-425a-b140-ae5cb06dd2c5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1331 microversion: 2.1 time: 0.130616 Oct 04 08:56:25.626437 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 292/588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:25 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:25.708849 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-930f0814-ca68-4029-9d47-97d5b2616c97 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 204 len: 0 microversion: 2.20 time: 0.398217 Oct 04 08:56:25.709527 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 297/589] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 4 08:56:25 2022] DELETE /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:56:25.717350 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:25.718124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:25.718248 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:25.719046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:25.726010 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.726745 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.726947 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.727357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.727568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.727922 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.728285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.728617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:25.728738 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.729067 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:25.729167 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.729511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:25.939343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.947520 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.949365 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.950839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:25.951990 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-46e61146-da03-4ff8-84b6-698e88c388dc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.238178 Oct 04 08:56:25.952731 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 298/590] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:25 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:25.958927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-12801233-dadf-4ff2-80ad-fec8942469d9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.245522 Oct 04 08:56:25.960157 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 293/591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:25 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:26.651202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:26.651858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:26.658197 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.658717 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.659160 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.659870 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.660375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.660810 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.693941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.694448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.694887 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.695335 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid 1a71a25f-8f53-4c71-8f61-9687de80f727 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:26.736756 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:26.744310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7531c170-91df-4ac6-8080-4c8dcb37267b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1331 microversion: 2.1 time: 0.097133 Oct 04 08:56:26.744872 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 299/592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:26 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:26.982978 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:26.983584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:26.983951 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:26.984557 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:26.991212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.991340 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.991483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.991586 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.991676 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.991905 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.992184 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.992582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:26.992702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.993029 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:26.993150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:26.993446 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.194292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.198141 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.202650 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.204086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.205235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-25fa4407-0b52-4eca-9093-19323c092602 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.225064 Oct 04 08:56:27.205799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 300/593] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:26 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:27.209183 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d6266f2b-ef07-4872-92a8-b857f8f3812a tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.230316 Oct 04 08:56:27.209864 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 294/594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:26 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:27.768452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:27.769058 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:27.776131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:27.776610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:27.777038 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.777714 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:27.778165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:27.778622 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.808951 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:27.809418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:27.809856 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:27.810292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid 1a71a25f-8f53-4c71-8f61-9687de80f727 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:27.850706 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:27.858395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-fba26ee7-f666-4e6e-9b13-aa9814651a9a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1331 microversion: 2.1 time: 0.093868 Oct 04 08:56:27.858987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 301/595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:27 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:28.229780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:28.230393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:28.232470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:28.233075 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:28.237125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.237602 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.238042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.238770 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.239096 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.239205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.239573 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.239690 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.240005 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.240681 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.241165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.241556 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.429582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.433803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.438085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5f0d5b66-13a9-4ca6-a5de-b8be2b21fc49 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.209392 Oct 04 08:56:28.438799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 302/596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:28 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:28.442885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.444346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.445505 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-38f70652-f368-41d5-b2d3-64ff9292d734 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.219718 Oct 04 08:56:28.446057 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 295/597] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:28 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:28.881966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:28.882621 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:28.889262 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.889742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.890186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.890898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.891350 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.891769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.922510 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:28.922987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:28.923419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:28.923862 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid 1a71a25f-8f53-4c71-8f61-9687de80f727 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:28.926605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:28.964586 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:28.972650 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-26f13374-60a8-4844-ab72-0217d6bfa2f1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1331 microversion: 2.1 time: 0.095026 Oct 04 08:56:28.973311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 303/598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:28 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:29.461655 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:29.462261 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:29.468898 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.469384 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.469815 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.470532 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.470874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:29.470994 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.471396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.471495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:29.478450 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.478932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.479362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.480044 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:29.480491 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:29.480908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:29.666098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.669276 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.674421 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1fa9e87c-1d42-42ee-b498-00cac7e11c8e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.216528 Oct 04 08:56:29.675111 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 296/599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:29 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:29.677706 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.679162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:29.680325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c2faa7cf-9341-4df0-9839-1db62b276af9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1721 microversion: 2.20 time: 0.213275 Oct 04 08:56:29.680874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 304/600] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:29 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:29.995438 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:29.996084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:30.002182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.002697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.003138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.003836 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.004289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.004821 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.038660 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.039142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.039581 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.040031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid 1a71a25f-8f53-4c71-8f61-9687de80f727 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:30.080779 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.089853 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a873cc8a-feef-4517-b685-8d4bc139fc06 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 200 len: 1331 microversion: 2.1 time: 0.098287 Oct 04 08:56:30.099791 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 297/601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:29 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:30.697343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:30.698019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:30.700729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:30.707406 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.707545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:30.707971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.708067 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:30.708175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.708968 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.709274 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.709583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.715564 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.716170 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.717537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.718619 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:30.719679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:30.721547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:30.815497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.826122 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.828196 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.829509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b930dab2-68a1-4e72-abf0-35874cf252b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1654 microversion: 2.20 time: 0.128112 Oct 04 08:56:30.834866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 298/602] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:30 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1654 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:30.883656 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:30.892486 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-567658c8-167d-40a2-9df1-e8a1ea563e53 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.199016 Oct 04 08:56:30.893059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 305/603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:30 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:31.008705 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-29cd63df-a359-43cd-845d-0b19a07da5f6 req-5d9fff88-e8e7-4e4e-bc8f-629b6b3efa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acaf703d-ba5c-4518-a5d9-afa1a34dcfd1", "name": "network-vif-deleted", "tag": "e0969193-60ee-4fb7-ba1b-70b50bfb9b9d"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:31.013762 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:31.019122 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-29cd63df-a359-43cd-845d-0b19a07da5f6 req-5d9fff88-e8e7-4e4e-bc8f-629b6b3efa52 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.019658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-29cd63df-a359-43cd-845d-0b19a07da5f6 req-5d9fff88-e8e7-4e4e-bc8f-629b6b3efa52 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.020084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-29cd63df-a359-43cd-845d-0b19a07da5f6 req-5d9fff88-e8e7-4e4e-bc8f-629b6b3efa52 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.031189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-29cd63df-a359-43cd-845d-0b19a07da5f6 req-5d9fff88-e8e7-4e4e-bc8f-629b6b3efa52 service nova] Creating event network-vif-deleted:e0969193-60ee-4fb7-ba1b-70b50bfb9b9d for instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 on hv-cinder-85944 Oct 04 08:56:31.036979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-29cd63df-a359-43cd-845d-0b19a07da5f6 req-5d9fff88-e8e7-4e4e-bc8f-629b6b3efa52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Oct 04 08:56:31.037884 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 299/604] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:31.121399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:31.122673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:31.130328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.131115 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.131715 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.133058 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.133716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.134602 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.154526 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 HTTP/1.1 Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:56:31.156549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:56:31.157924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '1a71a25f-8f53-4c71-8f61-9687de80f727'} Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:31.158997 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:56:31.162047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:31.164871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:31.164871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d50db6ca-d596-4a98-ae31-628219b773d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 404 len: 111 microversion: 2.1 time: 0.040679 Oct 04 08:56:31.168920 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-41b8cc65-91d8-4ea2-be4f-5734f2357273 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '.version_select at 0x7f6f1a51d040>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:31.174021 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 306/605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:31 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:31.279590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-41b8cc65-91d8-4ea2-be4f-5734f2357273 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985041803" status: 202 len: 0 microversion: 2.1 time: 0.115266 Oct 04 08:56:31.283771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 300/606] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 4 08:56:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985041803 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:56:31.860347 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:31.861649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:31.872641 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.873174 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.873831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.874702 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.875274 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.875684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.913697 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.914616 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.915189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.915724 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lazy-loading 'fault' on Instance uuid acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:31.918870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:31.919735 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:31.927302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.928974 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.929444 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.930731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:31.931419 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:31.932054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:31.989143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.002206 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.005550 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.007368 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-187d4fee-ac68-4612-b524-d0838ac01356 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 200 len: 1371 microversion: 2.20 time: 0.151182 Oct 04 08:56:32.019260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 307/607] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:31 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:32.116024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:32.135894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e8c5d9b6-429c-499b-8d39-93f2eda741be tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.222172 Oct 04 08:56:32.170610 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 301/608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:31 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:32.197090 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a2c476d7-a4ae-429b-b59d-1697515758f2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: .version_select at 0x7f6f1a376af0>, body: {"keypair": {"name": "tempest-keypair-1996255650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4vvUOzrPJlcfUXmeugldmdsGWoMalH8rCyFOb1Cz182giMW+dVd6eZ1ABEKyoQQG2n/mGLLd/q0AmGfqoLV8JkNJ0MqCDx6/ledOlJX1KfrFdxsCWt0t4M579JyRhh0Q=="}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:32.214128 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-a2c476d7-a4ae-429b-b59d-1697515758f2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for project 8760be982f804a9aa319b989aa1c3118. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:56:32.218564 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-a2c476d7-a4ae-429b-b59d-1697515758f2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for user 14d56042415540a3b3ed06578b712ca5 and project 8760be982f804a9aa319b989aa1c3118. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:56:32.320957 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a2c476d7-a4ae-429b-b59d-1697515758f2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127951 Oct 04 08:56:32.321564 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 308/609] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:56:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:33.036729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:33.037364 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:33.044078 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.044559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.044996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.045680 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.046132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.046589 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.061748 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] HTTP exception thrown: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Request method failure captured: Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 HTTP/1.1 Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q1bS2Rso7HwHIxnKtH06ZGqYmE2XZ8q9NmwluJcrTAkxL9mDrTZPycDNqrTri82W3hJkvNuiQAdY4tPHd_Mk6ZO2cr9qDLYK8Q5LDJwv5e47Sl90R9a0H85ekwPytsOT90u9gOVpZ7XDPkKWGIKXPKIQOgEi1tUGMwayVNRmoHGp8 Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:56:33.063428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f3deef8b1cc4c9193e9357f0ba99e15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 835a297b6e75416ea9bd1a82b466b2a9 Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:56:33.064936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'acaf703d-ba5c-4518-a5d9-afa1a34dcfd1'} Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:33.065880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:56:33.067513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:56:33.068576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Returning 404 to user: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:33.068576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-69fc14ec-87a3-4f43-935f-5c9b3ab92543 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 404 len: 111 microversion: 2.20 time: 0.032910 Oct 04 08:56:33.068576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 302/610] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:33 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:56:33.075205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3efb9c33-464c-4270-a349-3c660f612733 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '.version_select at 0x7f6f1a5e5430>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:33.159466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:33.161232 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:33.167453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.167947 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.168389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.169092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:33.169551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:33.169988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:33.205180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3efb9c33-464c-4270-a349-3c660f612733 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816089780" status: 204 len: 0 microversion: 2.20 time: 0.134579 Oct 04 08:56:33.205764 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 309/611] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 4 08:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816089780 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:56:33.348440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:33.356656 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a1cecdea-2927-4d2a-9f58-14c15497eb6b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.200997 Oct 04 08:56:33.357212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 303/612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:33 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:34.095839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-708abdd3-e47e-4db4-b511-f08cd8d48d4e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'create', calling method: .version_select at 0x7f6f1a2cd280>, body: {"keypair": {"name": "tempest-keypair-1770376321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCGcdj9zLHzaV+sVu1Zlsh5QNxL52ISRfSL+Qb3ucmghG6mwiiGnvsQ+NPNIozMlvrlVMROygkNljGzisKSnQOnRLiQRq5IoUGlRv/TogfX7Qv3eNIrQNmotXPiSXrwsA=="}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:34.112889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-708abdd3-e47e-4db4-b511-f08cd8d48d4e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Getting quotas for project 3f3deef8b1cc4c9193e9357f0ba99e15. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:56:34.118022 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-708abdd3-e47e-4db4-b511-f08cd8d48d4e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Getting quotas for user 835a297b6e75416ea9bd1a82b466b2a9 and project 3f3deef8b1cc4c9193e9357f0ba99e15. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:56:34.217053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-708abdd3-e47e-4db4-b511-f08cd8d48d4e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.125768 Oct 04 08:56:34.217590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 310/613] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Oct 4 08:56:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 08:56:34.380736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:34.381495 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:34.389175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.389794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.390504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.391271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:34.391793 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:34.392280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:34.567901 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:34.571658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:34.576886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a1d2c205-1941-46ac-8544-68971f9d539e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.200591 Oct 04 08:56:34.577623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 304/614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:34 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:35.182826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1078797134", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38eace1c-70a5-4e3a-880c-50986fb2cf27"}], "security_groups": [{"name": "tempest-securitygroup--2089764495"}], "key_name": "tempest-keypair-1996255650", "user_data": "}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:35.291098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] validate_networks() for [('38eace1c-70a5-4e3a-880c-50986fb2cf27', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:56:35.601391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:35.602000 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:35.609233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.609719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.610152 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.610877 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.611326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.611747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.730357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:56:35.730869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:56:35.731771 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:56:35.732340 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:56:35.733048 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:56:35.743172 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.743816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.744259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.745101 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:35.745877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:35.746490 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:35.765023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for project 8760be982f804a9aa319b989aa1c3118. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:56:35.769514 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for user 14d56042415540a3b3ed06578b712ca5 and project 8760be982f804a9aa319b989aa1c3118. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:56:35.778733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:35.781207 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:56:35.783580 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:56:35.787547 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c7c07167-fca4-4250-8143-1c724bc158df tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.190838 Oct 04 08:56:35.788118 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 305/615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:35 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:35.898661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0682dce5-a6b0-4f85-a303-a147a7c508a0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.720921 Oct 04 08:56:35.899312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 311/616] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:56:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:56:35.913273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d58a6a6a-d69c-4704-8d5d-29f6c2aacbf0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:35.914219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d58a6a6a-d69c-4704-8d5d-29f6c2aacbf0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:35.969182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d58a6a6a-d69c-4704-8d5d-29f6c2aacbf0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:35.977598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d58a6a6a-d69c-4704-8d5d-29f6c2aacbf0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1242 microversion: 2.1 time: 0.070674 Oct 04 08:56:35.978583 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 306/617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:35 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:36.711305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-8456123", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19b6a461-a067-4350-add8-ace0265cc9ea"}], "security_groups": [{"name": "tempest-securitygroup--852726610"}], "key_name": "tempest-keypair-1770376321", "user_data": "}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:36.811491 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:36.812100 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:36.816949 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] validate_networks() for [('19b6a461-a067-4350-add8-ace0265cc9ea', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:56:36.820073 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.820563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.820996 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:36.821687 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:36.822137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:36.822587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.025467 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:37.033930 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-26cf260e-0379-4a06-853e-c11d3e11b31e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.226220 Oct 04 08:56:37.034509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 307/618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:36 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:37.039691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:37.040305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:37.046278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.046816 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.047249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.047940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.048390 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.048810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.129711 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:37.137714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d0e890c4-f5e4-407c-9467-86e68f953035 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1246 microversion: 2.1 time: 0.101655 Oct 04 08:56:37.138353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 308/619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:37 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:37.289152 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:56:37.289607 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:56:37.290093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:56:37.290535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:56:37.290956 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:56:37.299830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.300351 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.301489 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.302227 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:37.303854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:37.303854 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:37.319627 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Getting quotas for project 3f3deef8b1cc4c9193e9357f0ba99e15. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:56:37.323438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Getting quotas for user 835a297b6e75416ea9bd1a82b466b2a9 and project 3f3deef8b1cc4c9193e9357f0ba99e15. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:56:37.334506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:56:37.336662 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:56:37.521951 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7b1c9cd2-fec4-4122-820c-11bd02c65d96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.816163 Oct 04 08:56:37.555648 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 312/620] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Oct 4 08:56:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 08:56:37.557469 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a89c50d8-3552-4dd3-b5c1-410f1529c029 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:37.557469 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a89c50d8-3552-4dd3-b5c1-410f1529c029 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:37.597015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a89c50d8-3552-4dd3-b5c1-410f1529c029 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:37.606568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a89c50d8-3552-4dd3-b5c1-410f1529c029 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:37.608025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a89c50d8-3552-4dd3-b5c1-410f1529c029 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:37.609186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a89c50d8-3552-4dd3-b5c1-410f1529c029 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1279 microversion: 2.20 time: 0.078980 Oct 04 08:56:37.609742 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 309/621] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:37 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1279 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:38.058150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:38.058818 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:38.065661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:38.067800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:38.067800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.067800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:38.068085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:38.068652 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.161579 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:38.162183 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:38.170641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:38.171127 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:38.171561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.172259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:38.172765 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:38.173189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.417194 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.425143 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5ba22714-7f87-4061-b34e-93642041a208 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1246 microversion: 2.1 time: 0.268090 Oct 04 08:56:38.425806 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 310/622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:38 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1246 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:38.434263 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.443374 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e9218996-36e4-4669-aea1-5db438b05b00 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.389560 Oct 04 08:56:38.444116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 313/623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:38 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:38.635929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:38.636554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:38.642376 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:38.642878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:38.643334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.644009 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:38.645037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:38.645509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:38.706502 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.715269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.716709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:38.717803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-939662a3-64ec-479a-997f-97e548f88925 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1283 microversion: 2.20 time: 0.086066 Oct 04 08:56:38.718365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 311/624] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:38 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1283 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:39.448472 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:39.449078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:39.455457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.455930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.456361 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.457164 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.457637 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.458055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.467167 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:39.467772 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:39.474778 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.475255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.475688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.476368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.476816 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.477237 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.521697 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:39.529932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-afbbebc5-7571-43a5-908f-06600d81a7d7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1246 microversion: 2.1 time: 0.085253 Oct 04 08:56:39.532512 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 314/625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:39 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:39.621424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:39.630024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6becc33e-340a-42e8-87bc-4f39837be94b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.166542 Oct 04 08:56:39.630625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 312/626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:39 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:39.742961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:39.743572 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:39.749456 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.749937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.750374 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.751083 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:39.751536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:39.751960 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:39.811902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:39.820065 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:39.821506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:39.822633 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-024f2261-e831-4567-9c3e-39b6be5ad03b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1283 microversion: 2.20 time: 0.083543 Oct 04 08:56:39.823191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 315/627] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:39 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:40.554671 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:40.556572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:40.561427 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.561922 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.562392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.563156 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.563614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.564048 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.626453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.635117 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2078acd8-66f9-4bca-bfd8-9254442145bd tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1294 microversion: 2.1 time: 0.084791 Oct 04 08:56:40.635681 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 313/628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:40 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:40.653202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:40.653751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:40.660624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.661109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.662079 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.662920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.663388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.663816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.796934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.805214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a622142a-30e2-4928-80c0-f0add44e9a71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.155941 Oct 04 08:56:40.805772 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 316/629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:40 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:40.849885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:40.850525 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:40.858139 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.858848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.859654 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.861605 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:40.862340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:40.863282 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:40.936193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.945494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.949211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:40.949211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-675ac630-73b9-4d4c-ad06-27f27308fdb3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1275 microversion: 2.20 time: 0.102796 Oct 04 08:56:40.949211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 314/630] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:40 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:41.558094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:41.558666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:41.565062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.565703 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.566158 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.566901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.567361 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.567856 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.658200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lazy-loading 'services' on Instance uuid b087fca8-b245-4d5b-8cd3-1baec0ad7560 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:56:41.658911 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:41.659287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:41.669099 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.670883 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.676981 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.676981 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.676981 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.676981 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.752084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:41.760211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1ff1bfdd-eff1-4dc3-b09f-15478dc65a33 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1300 microversion: 2.1 time: 0.105559 Oct 04 08:56:41.760770 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 315/631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:41 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:41.829784 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:41.830672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:41.836855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.837346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.837786 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.838517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.838979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.839397 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.928761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-21841e3d-3715-4071-b27b-9c8b393ec6b5 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/os-volume_attachments/60826c0e-b9e1-424c-b220-572fac0657bd" status: 202 len: 0 microversion: 2.1 time: 0.369016 Oct 04 08:56:41.928761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 317/632] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:56:41 2022] DELETE /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/os-volume_attachments/60826c0e-b9e1-424c-b220-572fac0657bd => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:56:41.977832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:41.978555 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:41.989001 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.989496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.990461 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.991152 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:41.991596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:41.992013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:41.992656 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.001887 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cb111de5-8ebc-42af-9a8e-7c54ee9c5cb5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.176626 Oct 04 08:56:42.002475 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 316/633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:41 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:42.073656 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.082247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.084665 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.085826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b5905735-5937-4fdb-a344-f64ea5e834bf tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1331 microversion: 2.20 time: 0.112410 Oct 04 08:56:42.086781 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 318/634] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:41 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:42.790628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:42.791173 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:42.797551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.798024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.798487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.799219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:42.799669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:42.800094 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:42.931921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:42.939591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2f7249d0-0e55-40ba-932b-fa93fbadae5f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.153874 Oct 04 08:56:42.940149 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 317/635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:42 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:43.026973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:43.028190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:43.035525 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.036022 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.036981 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.038033 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.038521 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.039148 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.111031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:43.111729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:43.118545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.122515 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.122515 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.122515 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.122515 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.122880 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.197952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:43.210123 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:43.211955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:43.212291 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:43.213891 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-08c335c9-c49d-4075-b389-b27950b31b34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1339 microversion: 2.20 time: 0.106921 Oct 04 08:56:43.214752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 318/636] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:43 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:43.220900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ef7fc6db-e4f7-4e61-973d-fdca2f792e71 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.198169 Oct 04 08:56:43.221703 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 319/637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:43 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:43.963034 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:43.963669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:43.969708 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.970190 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.970648 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.971359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:43.971814 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:43.972236 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:43.997666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-5de59e81-b800-41a6-863b-ecb70f8cfae7 req-6827d0a4-3ff0-405e-94aa-a6bb7f256cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01deb208-ffd0-4664-90dc-aca0a3fff70e", "tag": "3f7e3944-8bfb-4131-9b47-16932063c516"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:44.015624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5de59e81-b800-41a6-863b-ecb70f8cfae7 req-6827d0a4-3ff0-405e-94aa-a6bb7f256cf6 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.016287 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5de59e81-b800-41a6-863b-ecb70f8cfae7 req-6827d0a4-3ff0-405e-94aa-a6bb7f256cf6 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.017024 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5de59e81-b800-41a6-863b-ecb70f8cfae7 req-6827d0a4-3ff0-405e-94aa-a6bb7f256cf6 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.031471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-5de59e81-b800-41a6-863b-ecb70f8cfae7 req-6827d0a4-3ff0-405e-94aa-a6bb7f256cf6 service nova] Creating event network-changed:3f7e3944-8bfb-4131-9b47-16932063c516 for instance 01deb208-ffd0-4664-90dc-aca0a3fff70e on hv-cinder-85944 Oct 04 08:56:44.050802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-5de59e81-b800-41a6-863b-ecb70f8cfae7 req-6827d0a4-3ff0-405e-94aa-a6bb7f256cf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056767 Oct 04 08:56:44.053984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 320/638] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:56:44.173858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:44.183353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-992f2472-9d24-4837-92f0-e35ff9d2de6c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.224467 Oct 04 08:56:44.184198 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 319/639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:43 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:44.241116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:44.241833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:44.244515 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:44.247011 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:44.255415 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.263625 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.263796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.263885 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.263970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.263970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.264137 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.264137 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.264285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:44.264370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.264455 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:44.264455 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:44.365308 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:44.385560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:44.388474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:44.389944 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6cd8d10e-c85f-4500-bab3-6f0693f4c2af tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1337 microversion: 2.20 time: 0.153320 Oct 04 08:56:44.391079 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 321/640] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:44 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1337 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:44.463003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:44.477636 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cfb19896-1c5f-466c-a344-ba82341eb129 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.237329 Oct 04 08:56:44.478237 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 320/641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:44 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:45.206763 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.207381 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.214012 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.214518 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.214955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.215651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.216102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.216525 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.262236 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-017c2d2c-f211-439a-8417-8799f76b5b55 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:45.268971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-017c2d2c-f211-439a-8417-8799f76b5b55 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.269456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-017c2d2c-f211-439a-8417-8799f76b5b55 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.269916 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-017c2d2c-f211-439a-8417-8799f76b5b55 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.341327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-017c2d2c-f211-439a-8417-8799f76b5b55 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Going to try to stop instance {{(pid=127549) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 08:56:45.381043 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.389434 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2f885ca4-79af-4317-9082-cfd21fbca563 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.186588 Oct 04 08:56:45.392760 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 322/642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:45 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:45.421974 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.427158 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.428764 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.429262 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.429708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.430487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.431020 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.431451 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.570747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.579136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.580579 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.581889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3a311dfd-1e30-4af7-855a-7d07dc8750e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.163748 Oct 04 08:56:45.582774 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 323/643] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:45 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:56:45.588822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.589426 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.599665 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.601352 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-017c2d2c-f211-439a-8417-8799f76b5b55 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/action" status: 202 len: 0 microversion: 2.1 time: 0.342983 Oct 04 08:56:45.602232 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 321/644] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:56:45 2022] POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:56:45.602890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.616235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.616235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.616235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.616235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.621792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:45.622548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:45.631479 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.633892 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.637463 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.639365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:45.639365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:45.641588 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:45.678110 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:45.813540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.817386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:45.823471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-74a089b2-3998-41d6-a3ba-2a89be319b5d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1736 microversion: 2.1 time: 0.238671 Oct 04 08:56:45.824323 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 324/645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:45 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:45.842950 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:45.851494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f24d36af-eca1-4998-8571-6b5ff834183f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.233896 Oct 04 08:56:45.852153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 322/646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:45 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:46.418830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.419541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.430605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.430990 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.431483 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.432187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.432638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.433068 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.574052 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.583207 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-523ec324-52f7-4f83-b8dd-5d4b13ed1e7d tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.168559 Oct 04 08:56:46.595987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 325/647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:46 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:46.621487 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.622109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.629327 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.630482 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.630482 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.631207 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.631907 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.632423 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.737505 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-00405cc1-7039-4129-a5e9-f1be43b01f76 req-805681ea-1bfa-48b5-b44e-e1e97a91dfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feee8000-fafa-45b3-be22-370bb07f0c88", "tag": "7224ed3c-c9cb-445e-bb2f-be715b606313"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:46.750614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-00405cc1-7039-4129-a5e9-f1be43b01f76 req-805681ea-1bfa-48b5-b44e-e1e97a91dfcd service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.751164 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-00405cc1-7039-4129-a5e9-f1be43b01f76 req-805681ea-1bfa-48b5-b44e-e1e97a91dfcd service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.751601 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-00405cc1-7039-4129-a5e9-f1be43b01f76 req-805681ea-1bfa-48b5-b44e-e1e97a91dfcd service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.765023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-00405cc1-7039-4129-a5e9-f1be43b01f76 req-805681ea-1bfa-48b5-b44e-e1e97a91dfcd service nova] Creating event network-changed:7224ed3c-c9cb-445e-bb2f-be715b606313 for instance feee8000-fafa-45b3-be22-370bb07f0c88 on hv-cinder-85944 Oct 04 08:56:46.770139 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-00405cc1-7039-4129-a5e9-f1be43b01f76 req-805681ea-1bfa-48b5-b44e-e1e97a91dfcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036139 Oct 04 08:56:46.770708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 326/648] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:46.773832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.782579 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.784066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:46.791483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cf231357-8b7e-4f56-9234-72bc4b3c53f4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.170831 Oct 04 08:56:46.791483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 323/649] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:46 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:46.847772 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.848468 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.851098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:46.855853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.856329 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.856761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.857441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.857892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.858310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.874258 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:46.874927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:46.881097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.881581 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.882025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:46.882783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:46.883294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:46.883718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.061310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.066704 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.071193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e28826d5-748c-496d-9a37-f78d49e6bc58 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1716 microversion: 2.1 time: 0.227453 Oct 04 08:56:47.071833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 327/650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:46 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1716 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:47.074156 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-3b6ccb82-5796-4ca9-8edc-a787063f87d6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.203815 Oct 04 08:56:47.074772 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 324/651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:46 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:47.186112 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:47.186651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:47.193612 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.194095 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.194561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.195254 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.195708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.196130 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.279556 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] HTTP exception thrown: Cannot 'detach_volume' instance 836bad03-671e-48e3-8931-55435b0139d5 while it is in vm_state rescued Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Request method failure captured: Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments/14538882-3782-4edb-b107-59871e135126 HTTP/1.1 Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q8nvQCICfen3pq97UBwOKAMoZuSLY4oYNU1g1pfzcE7nSRmscvW6djdCBaFthjVByDfjI7bcnzGrhG0chZkiFXoV5uEzdauqf-NQNNqVkMZE8rIvPG2Ro5fFh5MoE5uvuaSXXp6IxgVox7YnOY7DKJ-fvcK4qinIf0Ca7fW_5aQVM Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:56:47.281187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b4590edfe642bc8a8bd15a1b8ba464", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 185e359e571f44bda1585124529b36a8 Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:56:47.287565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Cannot 'detach_volume' instance 836bad03-671e-48e3-8931-55435b0139d5 while it is in vm_state rescued Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'server_id': '836bad03-671e-48e3-8931-55435b0139d5', 'id': '14538882-3782-4edb-b107-59871e135126'} Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 836bad03-671e-48e3-8931-55435b0139d5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:56:47.288304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 836bad03-671e-48e3-8931-55435b0139d5 while it is in vm_state rescued Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 836bad03-671e-48e3-8931-55435b0139d5 while it is in vm_state rescued Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:56:47.289617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Returning 409 to user: Cannot 'detach_volume' instance 836bad03-671e-48e3-8931-55435b0139d5 while it is in vm_state rescued {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:56:47.290746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3a8688ab-7cf8-4d0a-8f94-19cdcf03e249 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "DELETE /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments/14538882-3782-4edb-b107-59871e135126" status: 409 len: 152 microversion: 2.1 time: 0.100663 Oct 04 08:56:47.290746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 328/652] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:56:47 2022] DELETE /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments/14538882-3782-4edb-b107-59871e135126 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 08:56:47.292216 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:47.292741 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:47.298688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.299171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.299604 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.300292 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.300752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.301172 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.512064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bf42d50e-3a23-4855-b503-c7a42fcb00e2 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "POST /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/action" status: 202 len: 0 microversion: 2.1 time: 0.223436 Oct 04 08:56:47.513011 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 325/653] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:56:47 2022] POST /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:56:47.521357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:47.522573 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:47.524971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=4 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:47.525641 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=20 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:47.531850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.532536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.532980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.533674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.534134 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.534615 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.607909 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=4 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:47.615249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:47.616539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:47.633035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.633574 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.633953 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.634987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.636107 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.636540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.720383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.730691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0998e493-e144-4ecd-a2c5-18515c9187b7 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1724 microversion: 2.1 time: 0.213195 Oct 04 08:56:47.731698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 329/654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:47 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:47.790113 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.797888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d3d9202c-b193-4db5-bc6c-f9ef42c8633e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.190856 Oct 04 08:56:47.798470 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 326/655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:47 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:47.819133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:47.820088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:47.827612 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.828519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.829207 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.829972 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:47.830565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:47.831262 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:47.985524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.994937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.996540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:47.997808 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f82f31fc-3331-49e6-aabe-e60c1007deb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.189799 Oct 04 08:56:47.998490 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 330/656] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:47 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:48.097827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:48.098582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:48.104561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.105108 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.105540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.106275 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.106767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.107245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.239354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:48.248622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ebc9b7c3-7584-466a-b92d-9ad7e21bdccd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.154646 Oct 04 08:56:48.249255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 327/657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:48 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:48.754934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:48.755555 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:48.764449 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.764937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.765374 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.766071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.766551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.766975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.821240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:48.821853 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:48.828250 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.828731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.829172 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.829861 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:48.830313 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:48.830760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:48.935889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:48.944522 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c55158df-9938-41e7-be53-e56a23778a07 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1724 microversion: 2.1 time: 0.193280 Oct 04 08:56:48.945097 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 331/658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:48 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:48.981092 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:48.989090 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0babf713-5682-4615-8a93-26e3aae1cd4f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.171887 Oct 04 08:56:48.990203 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 328/659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:48 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:49.024141 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:49.024747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:49.030676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:49.031239 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:49.031572 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:49.032263 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:49.032712 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:49.033135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:49.173745 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.182930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.187073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.187073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-afc18c79-4460-4ba1-9f74-e37bb55a7b99 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.165166 Oct 04 08:56:49.187073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 332/660] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:49 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:49.273545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:49.274074 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:49.280119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:49.280603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:49.281039 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:49.281731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:49.282185 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:49.282636 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:49.420730 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:49.429163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1ae45f48-e14c-4ae3-a150-68758505ac12 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.159722 Oct 04 08:56:49.429740 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 329/661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:49 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:49.968247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:49.968891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:49.975708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:49.976177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:49.976617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:49.977303 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:49.977757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:49.978182 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.012808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:50.013457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:50.020072 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.020560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.021737 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.024798 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.024798 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.024798 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.160426 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.169535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3e476a1b-ebbc-40d5-bfab-48b7e7535a39 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1724 microversion: 2.1 time: 0.205154 Oct 04 08:56:50.174570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 333/662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:49 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:50.190610 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.198378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-42544f0c-9af4-4981-81a9-1d2220243750 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.189785 Oct 04 08:56:50.198963 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 330/663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:50 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:50.209829 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:50.210361 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:50.216334 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.216812 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.217244 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.217945 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.218393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.218833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.358871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.367481 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.368927 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.370029 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8dc507f9-daee-4945-be58-80d31a36b5c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.164623 Oct 04 08:56:50.370614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 334/664] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:50 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:50.462078 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:50.462281 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:50.468297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.468852 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.469223 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.469959 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:50.470427 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:50.470860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:50.608168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:50.617085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4b718a2b-c0e8-4fbb-a7aa-33ce6ac798bc tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.162557 Oct 04 08:56:50.617659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 331/665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:50 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:51.193064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:51.194553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:51.200924 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.201413 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.201846 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.202575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.203024 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.203447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.221160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:51.221767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:51.228698 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.229188 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.229614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.230301 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.230771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.231192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.410080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.417476 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.419300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6ecc646a-8288-4ac9-b1f4-d92be60c61c3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1724 microversion: 2.1 time: 0.230105 Oct 04 08:56:51.419875 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 335/666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:51 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:51.424431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:51.425025 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:51.425824 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a3101c62-cfa1-408e-a422-d816ae2ed934 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.208181 Oct 04 08:56:51.431440 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.431919 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.432350 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.437487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.437487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.437487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.438045 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 332/667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:51 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:51.566776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.576075 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.578091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.579377 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5bb19966-c7d4-4c6f-8222-46399713eca2 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.158597 Oct 04 08:56:51.579930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 336/668] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:51 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:51.640447 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:51.641054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:51.647365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.647835 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.648264 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.648939 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:51.649381 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:51.649919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:51.778080 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:51.785757 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bc384255-21e8-4564-b00c-6285ae5076ce tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.149102 Oct 04 08:56:51.786320 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 333/669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:51 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:52.443310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:52.444522 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:52.452483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:52.453517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:52.455191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.458891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.458891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.458891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.458891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.459228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.460563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.461273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.461725 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.462524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.463418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.464371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.666953 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.676216 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f84888cc-bba7-4062-8b18-d34b66d2080b tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.228449 Oct 04 08:56:52.679443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 334/670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:52 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:52.683238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:52.684109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:52.690058 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.690842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.691506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.692391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.693306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.693826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.709625 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.717960 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bb48f2f3-b09e-4d02-aeb0-4247a272e012 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1730 microversion: 2.1 time: 0.278485 Oct 04 08:56:52.719571 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 337/671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:52 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:52.722952 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-fe4b85a0-7e57-4dbf-be3e-6e96637cb38d req-0fa4b32b-71cf-4526-a792-12c43a377813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01deb208-ffd0-4664-90dc-aca0a3fff70e", "name": "network-vif-plugged", "status": "completed", "tag": "3f7e3944-8bfb-4131-9b47-16932063c516"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:52.733158 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-fe4b85a0-7e57-4dbf-be3e-6e96637cb38d req-0fa4b32b-71cf-4526-a792-12c43a377813 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.733801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-fe4b85a0-7e57-4dbf-be3e-6e96637cb38d req-0fa4b32b-71cf-4526-a792-12c43a377813 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.734223 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-fe4b85a0-7e57-4dbf-be3e-6e96637cb38d req-0fa4b32b-71cf-4526-a792-12c43a377813 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.745390 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-fe4b85a0-7e57-4dbf-be3e-6e96637cb38d req-0fa4b32b-71cf-4526-a792-12c43a377813 service nova] Creating event network-vif-plugged:3f7e3944-8bfb-4131-9b47-16932063c516 for instance 01deb208-ffd0-4664-90dc-aca0a3fff70e on hv-cinder-85944 Oct 04 08:56:52.750752 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-fe4b85a0-7e57-4dbf-be3e-6e96637cb38d req-0fa4b32b-71cf-4526-a792-12c43a377813 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 Oct 04 08:56:52.751524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 338/672] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:52.757302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:52.758104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:52.773536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.774023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.774658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.775534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.776174 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.776766 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.895595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-dd6f49d8-7dbf-4a4e-9bd4-135b18e05055 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142647 Oct 04 08:56:52.896303 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 339/673] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 4 08:56:52 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:52.902307 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:52.903019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:52.909138 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.909844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.910346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.911255 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:52.911720 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:52.917798 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:52.918471 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.929074 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.930851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:52.932201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c6d9c948-6f55-4104-9ec2-00528916c7b3 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.253403 Oct 04 08:56:52.932877 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 335/674] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:52 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:53.113101 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:53.123717 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6e9d16df-0950-4b10-b57f-179b75a58cd2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.225399 Oct 04 08:56:53.130536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 340/675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:52 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:53.701051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:53.701744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:53.709063 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:53.714842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:53.714842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:53.714842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:53.714842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:53.715272 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:53.855848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:53.863480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-aa437dc8-f38e-4502-bc11-81d7b49b5a89 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.167331 Oct 04 08:56:53.874587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 336/676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:53 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:53.964687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:53.965341 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:53.971915 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:53.972404 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:53.972841 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:53.973534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:53.973993 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:53.975365 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:54.019982 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-64c3014e-7186-496b-b0ba-53dda2c1ef72 req-a735f01e-f085-41ac-aab4-dd73b16362a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836bad03-671e-48e3-8931-55435b0139d5", "tag": "58411766-09ff-4773-bf48-970dc9dc8309"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:54.030195 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-64c3014e-7186-496b-b0ba-53dda2c1ef72 req-a735f01e-f085-41ac-aab4-dd73b16362a6 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:54.030927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-64c3014e-7186-496b-b0ba-53dda2c1ef72 req-a735f01e-f085-41ac-aab4-dd73b16362a6 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:54.031537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-64c3014e-7186-496b-b0ba-53dda2c1ef72 req-a735f01e-f085-41ac-aab4-dd73b16362a6 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:54.047338 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-64c3014e-7186-496b-b0ba-53dda2c1ef72 req-a735f01e-f085-41ac-aab4-dd73b16362a6 service nova] Creating event network-changed:58411766-09ff-4773-bf48-970dc9dc8309 for instance 836bad03-671e-48e3-8931-55435b0139d5 on hv-cinder-85944 Oct 04 08:56:54.052374 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-64c3014e-7186-496b-b0ba-53dda2c1ef72 req-a735f01e-f085-41ac-aab4-dd73b16362a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036020 Oct 04 08:56:54.053001 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 337/677] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:54.110995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:54.119393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:54.120856 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:54.121949 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ef76d6c7-789e-4887-9bdb-404db211e785 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.161165 Oct 04 08:56:54.122541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 341/678] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:53 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:54.149114 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:54.149804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:54.156002 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:54.156481 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:54.156910 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:54.157596 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:54.158042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:54.158558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:54.296001 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:54.300101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:54.306144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-aae073fe-30c8-40c8-8572-41882e4dd9a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.161816 Oct 04 08:56:54.306885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 338/679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:54 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:54.791012 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-aaa26d6a-ad64-4126-8d2b-2ff3e09bfc19 req-e3271544-d659-4013-96ce-d90edefeb3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feee8000-fafa-45b3-be22-370bb07f0c88", "name": "network-vif-plugged", "status": "completed", "tag": "7224ed3c-c9cb-445e-bb2f-be715b606313"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:54.800681 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-aaa26d6a-ad64-4126-8d2b-2ff3e09bfc19 req-e3271544-d659-4013-96ce-d90edefeb3d0 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:54.801143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-aaa26d6a-ad64-4126-8d2b-2ff3e09bfc19 req-e3271544-d659-4013-96ce-d90edefeb3d0 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:54.801567 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-aaa26d6a-ad64-4126-8d2b-2ff3e09bfc19 req-e3271544-d659-4013-96ce-d90edefeb3d0 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:54.813810 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-aaa26d6a-ad64-4126-8d2b-2ff3e09bfc19 req-e3271544-d659-4013-96ce-d90edefeb3d0 service nova] Creating event network-vif-plugged:7224ed3c-c9cb-445e-bb2f-be715b606313 for instance feee8000-fafa-45b3-be22-370bb07f0c88 on hv-cinder-85944 Oct 04 08:56:54.818836 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-aaa26d6a-ad64-4126-8d2b-2ff3e09bfc19 req-e3271544-d659-4013-96ce-d90edefeb3d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032214 Oct 04 08:56:54.825454 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 342/680] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:54.888201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:54.888877 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:54.895264 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:54.895747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:54.896185 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:54.897590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:54.898808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:54.899246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.034452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.043291 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-70752532-4c5f-4946-a52f-793eb6d8e01c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1368 microversion: 2.1 time: 0.159626 Oct 04 08:56:55.044104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 339/681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:54 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:55.164442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:55.166245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:55.184073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.185236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.186100 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.198011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.198982 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.199645 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.337170 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:55.338125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:55.346361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.347129 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.347721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.348693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:55.349828 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:55.350535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:55.398995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.402685 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:55.408230 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.409825 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.411245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-22ba1408-a6b9-4fed-afc3-ccf3bb74bf19 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.267252 Oct 04 08:56:55.427003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 343/682] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:55.513355 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:55.521105 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fd0bfa7e-916f-47f4-bba1-067deef69f3b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1676 microversion: 2.1 time: 0.187761 Oct 04 08:56:55.521807 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 340/683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:55 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:56.067112 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.067709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-ebbec216-c51f-4039-bc28-aec5f6c516a4 req-f357db6d-85b3-4196-9ed3-ea1edd434952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836bad03-671e-48e3-8931-55435b0139d5", "tag": "58411766-09ff-4773-bf48-970dc9dc8309"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:56.067850 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:56.074942 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.075430 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.075867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.076554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.077003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.077422 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.077815 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ebbec216-c51f-4039-bc28-aec5f6c516a4 req-f357db6d-85b3-4196-9ed3-ea1edd434952 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.078296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ebbec216-c51f-4039-bc28-aec5f6c516a4 req-f357db6d-85b3-4196-9ed3-ea1edd434952 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.078779 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-ebbec216-c51f-4039-bc28-aec5f6c516a4 req-f357db6d-85b3-4196-9ed3-ea1edd434952 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.090267 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-ebbec216-c51f-4039-bc28-aec5f6c516a4 req-f357db6d-85b3-4196-9ed3-ea1edd434952 service nova] Creating event network-changed:58411766-09ff-4773-bf48-970dc9dc8309 for instance 836bad03-671e-48e3-8931-55435b0139d5 on hv-cinder-85944 Oct 04 08:56:56.095182 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-ebbec216-c51f-4039-bc28-aec5f6c516a4 req-f357db6d-85b3-4196-9ed3-ea1edd434952 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031817 Oct 04 08:56:56.096082 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 344/684] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:56.420171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.428913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0bbb6f31-2265-4617-86a7-77c9d07b12cc tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1559 microversion: 2.1 time: 0.365632 Oct 04 08:56:56.430124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 341/685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1559 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:56:56.439213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.440732 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:56.447432 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.448133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.448560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.449561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.450028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.450471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.452553 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.453221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:56.459521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.460109 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.460680 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.461498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.462181 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.462729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.543948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-26e193f2-14ad-4784-b5b6-000438f9d57a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095916 Oct 04 08:56:56.544685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 342/686] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:56.554341 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.555227 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:56.561451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.561942 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.562384 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.563107 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.563563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.563990 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.703114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.712978 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.714938 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.716147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-fee330c3-bce1-4acb-bdb0-1fee012414c0 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1404 microversion: 2.20 time: 0.282467 Oct 04 08:56:56.716802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 345/687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1404 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:56.734298 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:56.742297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9a0ad418-9507-4ed5-9d22-cc96ea27226b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1653 microversion: 2.1 time: 0.194065 Oct 04 08:56:56.742896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 343/688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1653 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:56.764984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b4d53d87-fca1-4142-a60f-d0c1879da76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:56.771753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b4d53d87-fca1-4142-a60f-d0c1879da76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.772610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b4d53d87-fca1-4142-a60f-d0c1879da76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.773149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b4d53d87-fca1-4142-a60f-d0c1879da76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.795731 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b4d53d87-fca1-4142-a60f-d0c1879da76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Going to try to start instance {{(pid=127548) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 08:56:56.945177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b4d53d87-fca1-4142-a60f-d0c1879da76a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/action" status: 202 len: 0 microversion: 2.1 time: 0.183730 Oct 04 08:56:56.945920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 346/689] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:56:56 2022] POST /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:56:56.954689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:56.955316 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:56.962572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.963071 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.963514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:56.964221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:56.964704 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:56.965131 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:57.105067 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:57.114377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9ed44821-c12c-4a81-bcc2-ecd9804be164 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1662 microversion: 2.1 time: 0.163717 Oct 04 08:56:57.115991 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 344/690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:56 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:57.742341 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:57.743110 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:57.750381 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:57.750904 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:57.751339 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:57.752069 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:57.752526 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:57.752950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:57.885995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:57.894111 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:57.895581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:57.896845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7fcf8f00-ccb0-4903-b8ca-8a821b62d9bc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1595 microversion: 2.20 time: 0.158849 Oct 04 08:56:57.897402 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 347/691] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:56:57 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:56:57.922461 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:57.922767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:57.929698 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:57.930207 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:57.930646 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:57.931344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:57.931812 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:57.932236 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:58.023332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d39f155d-9e1e-452a-9d05-44ca6284762a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103002 Oct 04 08:56:58.024053 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 345/692] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Oct 4 08:56:57 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:56:58.139615 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:58.140217 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:58.150857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:58.151352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:58.151810 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:58.152505 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:58.152956 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:58.153378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:58.394925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-e24072a2-d7d6-4ea3-b2cd-3c8a3d3e76c3 req-95732b92-86f1-4d21-b75d-719d799095a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01deb208-ffd0-4664-90dc-aca0a3fff70e", "tag": "3f7e3944-8bfb-4131-9b47-16932063c516"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:58.400593 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:58.407175 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e24072a2-d7d6-4ea3-b2cd-3c8a3d3e76c3 req-95732b92-86f1-4d21-b75d-719d799095a5 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:58.413159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e24072a2-d7d6-4ea3-b2cd-3c8a3d3e76c3 req-95732b92-86f1-4d21-b75d-719d799095a5 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:58.413159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e24072a2-d7d6-4ea3-b2cd-3c8a3d3e76c3 req-95732b92-86f1-4d21-b75d-719d799095a5 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:58.416649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:58.424145 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-e24072a2-d7d6-4ea3-b2cd-3c8a3d3e76c3 req-95732b92-86f1-4d21-b75d-719d799095a5 service nova] Creating event network-changed:3f7e3944-8bfb-4131-9b47-16932063c516 for instance 01deb208-ffd0-4664-90dc-aca0a3fff70e on hv-cinder-85944 Oct 04 08:56:58.425388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-411c7ae5-ef1f-4579-8c39-25470088c07c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1662 microversion: 2.1 time: 0.289664 Oct 04 08:56:58.426486 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 348/693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:58 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1662 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:56:58.440712 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-e24072a2-d7d6-4ea3-b2cd-3c8a3d3e76c3 req-95732b92-86f1-4d21-b75d-719d799095a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051462 Oct 04 08:56:58.441783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 346/694] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:59.346573 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-1b56a8cb-a728-425f-b699-c937a75367c2 req-2dbe6851-79f8-4073-bfe6-507c0400a188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feee8000-fafa-45b3-be22-370bb07f0c88", "tag": "7224ed3c-c9cb-445e-bb2f-be715b606313"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:56:59.361562 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-1b56a8cb-a728-425f-b699-c937a75367c2 req-2dbe6851-79f8-4073-bfe6-507c0400a188 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:59.362062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-1b56a8cb-a728-425f-b699-c937a75367c2 req-2dbe6851-79f8-4073-bfe6-507c0400a188 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:59.362527 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-1b56a8cb-a728-425f-b699-c937a75367c2 req-2dbe6851-79f8-4073-bfe6-507c0400a188 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:59.383200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-1b56a8cb-a728-425f-b699-c937a75367c2 req-2dbe6851-79f8-4073-bfe6-507c0400a188 service nova] Creating event network-changed:7224ed3c-c9cb-445e-bb2f-be715b606313 for instance feee8000-fafa-45b3-be22-370bb07f0c88 on hv-cinder-85944 Oct 04 08:56:59.391212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-1b56a8cb-a728-425f-b699-c937a75367c2 req-2dbe6851-79f8-4073-bfe6-507c0400a188 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048189 Oct 04 08:56:59.392076 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 349/695] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:56:59.453552 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:56:59.454991 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:56:59.462642 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:59.463625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:59.464078 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:59.465238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:56:59.465324 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:56:59.465736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:56:59.644237 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:56:59.655377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-13e43f69-53d6-4c98-8ffe-b58611f7529b tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1666 microversion: 2.1 time: 0.207243 Oct 04 08:56:59.667179 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 347/696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:56:59 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1666 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:17.695524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1529661328"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:17.696092 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:17.698738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=45 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:17.699445 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:17.704462 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:17.706765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:17.706765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:17.706765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:17.706765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:17.707192 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:17.845560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.network.security_group_api [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Removing security group 0d2468c3-ae27-4b10-b824-090462463668 from port 4016b744-a552-4b39-96d5-0dd5bd2f34c4 Oct 04 08:57:18.206634 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-13875d6a-d9c9-4fa8-8f1b-34cbf3452a58 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "POST /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/action" status: 202 len: 0 microversion: 2.1 time: 0.515481 Oct 04 08:57:18.207335 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 350/697] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 08:57:17 2022] POST /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:18.216103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-141ea871-664e-4b57-b024-ec435339635e req-ba9922d4-51bd-4764-a37b-e9c6c32a34f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a4610c-eb87-46b5-bdb5-25c521d71a5d", "tag": "4016b744-a552-4b39-96d5-0dd5bd2f34c4"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:18.228966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:18.229992 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=46 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:18.231987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 08:57:18.232139 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Tue Oct 4 08:57:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 04 08:57:18.237583 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-141ea871-664e-4b57-b024-ec435339635e req-ba9922d4-51bd-4764-a37b-e9c6c32a34f2 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:18.239852 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-141ea871-664e-4b57-b024-ec435339635e req-ba9922d4-51bd-4764-a37b-e9c6c32a34f2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:18.239852 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-141ea871-664e-4b57-b024-ec435339635e req-ba9922d4-51bd-4764-a37b-e9c6c32a34f2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:18.254608 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-141ea871-664e-4b57-b024-ec435339635e req-ba9922d4-51bd-4764-a37b-e9c6c32a34f2 service nova] Creating event network-changed:4016b744-a552-4b39-96d5-0dd5bd2f34c4 for instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d on hv-cinder-85944 Oct 04 08:57:18.264313 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-141ea871-664e-4b57-b024-ec435339635e req-ba9922d4-51bd-4764-a37b-e9c6c32a34f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053294 Oct 04 08:57:18.264953 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 348/698] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:57:19.684911 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:19.685421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:19.691339 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:19.691822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:19.692254 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:19.692932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:19.693393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:19.693801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:19.776360 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lazy-loading 'services' on Instance uuid e3a4610c-eb87-46b5-bdb5-25c521d71a5d {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:19.997040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d61ada65-9577-4e99-81fc-9c7bdbb7347b tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments/f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3" status: 202 len: 0 microversion: 2.1 time: 0.316464 Oct 04 08:57:20.000597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 351/699] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:57:19 2022] DELETE /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments/f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:20.009314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:20.012657 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:20.021457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:20.021934 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:20.022365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:20.023080 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:20.024154 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:20.024620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:20.054706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ce7f91c3-727b-4140-83ff-76e0cae88dc0 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052263 Oct 04 08:57:20.055153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 349/700] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:20 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:20.282041 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-0d3ab19b-7622-41f7-87e0-407fa70fc01e req-425d452c-3d64-40b4-9c62-4dc72e440060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a4610c-eb87-46b5-bdb5-25c521d71a5d", "tag": "4016b744-a552-4b39-96d5-0dd5bd2f34c4"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:20.292420 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-0d3ab19b-7622-41f7-87e0-407fa70fc01e req-425d452c-3d64-40b4-9c62-4dc72e440060 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:20.292947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-0d3ab19b-7622-41f7-87e0-407fa70fc01e req-425d452c-3d64-40b4-9c62-4dc72e440060 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:20.293376 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-0d3ab19b-7622-41f7-87e0-407fa70fc01e req-425d452c-3d64-40b4-9c62-4dc72e440060 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:20.304657 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-0d3ab19b-7622-41f7-87e0-407fa70fc01e req-425d452c-3d64-40b4-9c62-4dc72e440060 service nova] Creating event network-changed:4016b744-a552-4b39-96d5-0dd5bd2f34c4 for instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d on hv-cinder-85944 Oct 04 08:57:20.309697 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-0d3ab19b-7622-41f7-87e0-407fa70fc01e req-425d452c-3d64-40b4-9c62-4dc72e440060 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031593 Oct 04 08:57:20.310448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 352/701] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:57:21.067116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:21.072741 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:21.076977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:21.077542 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:21.078051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:21.079156 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:21.079615 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:21.080103 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:21.110505 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ee9302aa-6cd9-4ee9-a283-ffd21c17ce3f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047311 Oct 04 08:57:21.111070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 350/702] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:21 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:22.124974 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:22.127307 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:22.135477 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:22.135966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:22.136406 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:22.137102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:22.137547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:22.137964 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:22.167594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-90c8a485-8a12-4d1a-810b-ab97f2d1ab1f tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047399 Oct 04 08:57:22.168155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 353/703] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:22 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:57:22.178888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:22.183202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:22.187111 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:22.187599 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:22.188043 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:22.188738 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:22.189191 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:22.189622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:22.265928 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] HTTP exception thrown: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d is not attached to volume f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3 Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Request method failure captured: Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: DELETE /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments/f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3 HTTP/1.1 Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_SgaYYiaukpuJx72ozbqFmjssXzSUpqK6_VmCATZUATDuMSZ8ICBBX5eiqMr1Y9czq-Fwy7uR8FGZWz9sT754jin7JYJiFSfxsv5VyN2lZatrbQZP4DxMTQcsAf7kXxAiauoECuZ5TcqoO2FCfJ664hvOrLT-Iuu8BwROBY-eMzoS0 Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: f6f4de2e638d4746a56a2d2023d2401b Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-TestMinimumBasicScenario-1249415293 Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:57:22.268378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f6f4de2e638d4746a56a2d2023d2401b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f6f4de2e638d4746a56a2d2023d2401b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f6f4de2e638d4746a56a2d2023d2401b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f6f4de2e638d4746a56a2d2023d2401b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-TestMinimumBasicScenario-1249415293 Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: f6f4de2e638d4746a56a2d2023d2401b Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1249415293 Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-TestMinimumBasicScenario-1249415293-project Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 21628ccf9dfb4ad1921aaf27712031c0 Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-TestMinimumBasicScenario-1249415293-project Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:57:22.269897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d is not attached to volume f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3 Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'server_id': 'e3a4610c-eb87-46b5-bdb5-25c521d71a5d', 'id': 'f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3'} Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3. Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:22.275507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d is not attached to volume f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3 Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d is not attached to volume f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3 Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:22.277319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Returning 404 to user: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d is not attached to volume f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3 {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:22.278383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d7ff772d-175a-4fc4-bcee-3cb883379a03 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments/f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3" status: 404 len: 154 microversion: 2.1 time: 0.094919 Oct 04 08:57:22.278383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 351/704] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:57:22 2022] DELETE /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d/os-volume_attachments/f7ca8cf3-1e0e-41e8-b4d7-03f53707c2e3 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:57:23.535334 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:23.535835 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:23.542811 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:23.543290 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:23.543748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:23.544424 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:23.544868 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:23.545287 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:23.569212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:57:23.843210 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-12b50f78-b393-480f-be80-885dc7b16aa6 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 204 len: 0 microversion: 2.1 time: 0.311329 Oct 04 08:57:23.843798 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 354/705] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:57:23 2022] DELETE /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:57:23.858498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:23.858498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:23.859725 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:23.860208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:23.860641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:23.861334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:23.861772 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:23.862194 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:23.989307 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:23.997623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ecde5da4-4c1d-4ecd-b756-fa65aadae641 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1555 microversion: 2.1 time: 0.149306 Oct 04 08:57:23.998171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 352/706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:23 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:25.021751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:25.022546 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:25.029418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:25.029899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:25.030387 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:25.031093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:25.031576 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:25.031998 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:25.172451 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:25.180877 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5bb08776-2492-42b6-a36f-e3f5bd697318 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1555 microversion: 2.1 time: 0.163302 Oct 04 08:57:25.181439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 355/707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:25 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:26.204412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:26.207019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:26.211784 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:26.212267 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:26.212721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:26.213395 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:26.213856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:26.214273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:26.343268 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:26.351056 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7c1685cf-519e-47db-a101-b1d2eb93170e tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1555 microversion: 2.1 time: 0.150564 Oct 04 08:57:26.352445 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 353/708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:26 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:26.516788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-bcb85427-729a-48a5-b045-3cd2d4918e2a req-f520961b-7647-43bb-a1f3-886100ce554b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a4610c-eb87-46b5-bdb5-25c521d71a5d", "name": "network-vif-deleted", "tag": "4016b744-a552-4b39-96d5-0dd5bd2f34c4"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:26.527143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bcb85427-729a-48a5-b045-3cd2d4918e2a req-f520961b-7647-43bb-a1f3-886100ce554b service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:26.527734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bcb85427-729a-48a5-b045-3cd2d4918e2a req-f520961b-7647-43bb-a1f3-886100ce554b service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:26.528162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bcb85427-729a-48a5-b045-3cd2d4918e2a req-f520961b-7647-43bb-a1f3-886100ce554b service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:26.541176 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-bcb85427-729a-48a5-b045-3cd2d4918e2a req-f520961b-7647-43bb-a1f3-886100ce554b service nova] Creating event network-vif-deleted:4016b744-a552-4b39-96d5-0dd5bd2f34c4 for instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d on hv-cinder-85944 Oct 04 08:57:26.546356 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-bcb85427-729a-48a5-b045-3cd2d4918e2a req-f520961b-7647-43bb-a1f3-886100ce554b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033168 Oct 04 08:57:26.547122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 356/709] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:27.375329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:27.375886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:27.382213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:27.382735 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:27.383164 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:27.383849 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:27.384298 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:27.384716 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:27.415576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:27.416049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:27.416477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:27.416916 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lazy-loading 'fault' on Instance uuid e3a4610c-eb87-46b5-bdb5-25c521d71a5d {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:27.459057 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21628ccf9dfb4ad1921aaf27712031c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f4de2e638d4746a56a2d2023d2401b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:27.467041 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-eee2dad6-8f8c-4d05-a42d-143c7866f48c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 200 len: 1349 microversion: 2.1 time: 0.095589 Oct 04 08:57:27.467623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 354/710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:27 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:28.491204 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:28.491904 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] [instance: e3a4610c-eb87-46b5-bdb5-25c521d71a5d] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:28.498592 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:28.499072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:28.499507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:28.500183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:28.500628 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:28.501048 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:28.516350 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] HTTP exception thrown: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d could not be found. Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Request method failure captured: Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d HTTP/1.1 Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_SgaYYiaukpuJx72ozbqFmjssXzSUpqK6_VmCATZUATDuMSZ8ICBBX5eiqMr1Y9czq-Fwy7uR8FGZWz9sT754jin7JYJiFSfxsv5VyN2lZatrbQZP4DxMTQcsAf7kXxAiauoECuZ5TcqoO2FCfJ664hvOrLT-Iuu8BwROBY-eMzoS0 Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: f6f4de2e638d4746a56a2d2023d2401b Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-TestMinimumBasicScenario-1249415293 Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:57:28.517930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f6f4de2e638d4746a56a2d2023d2401b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f6f4de2e638d4746a56a2d2023d2401b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f6f4de2e638d4746a56a2d2023d2401b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f6f4de2e638d4746a56a2d2023d2401b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-TestMinimumBasicScenario-1249415293 Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: f6f4de2e638d4746a56a2d2023d2401b Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1249415293 Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-TestMinimumBasicScenario-1249415293-project Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 21628ccf9dfb4ad1921aaf27712031c0 Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-TestMinimumBasicScenario-1249415293-project Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d could not be found. Oct 04 08:57:28.519438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'e3a4610c-eb87-46b5-bdb5-25c521d71a5d'} Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d could not be found. Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:28.520214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d could not be found. Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d could not be found. Oct 04 08:57:28.521604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:28.522900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Returning 404 to user: Instance e3a4610c-eb87-46b5-bdb5-25c521d71a5d could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:28.522900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-07364502-668f-4397-8c0b-428bd63e8f19 tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d" status: 404 len: 111 microversion: 2.1 time: 0.032429 Oct 04 08:57:28.522900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 357/711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:28 2022] GET /compute/v2.1/servers/e3a4610c-eb87-46b5-bdb5-25c521d71a5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:57:28.528720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e52048ae-9309-4608-87ba-11e3442fc97c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] Calling method '.version_select at 0x7f6f1a3d5af0>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:28.638859 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e52048ae-9309-4608-87ba-11e3442fc97c tempest-TestMinimumBasicScenario-1249415293 tempest-TestMinimumBasicScenario-1249415293-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1894365493" status: 202 len: 0 microversion: 2.1 time: 0.114491 Oct 04 08:57:28.639461 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 355/712] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Oct 4 08:57:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1894365493 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:33.143401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:33.144516 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:33.152413 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:33.153189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:33.153803 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:33.154542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:33.155354 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:33.155790 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:33.246716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lazy-loading 'services' on Instance uuid 836bad03-671e-48e3-8931-55435b0139d5 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:33.472072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-25d549c5-4fe7-4763-884a-0a7833aa07a5 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "DELETE /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments/14538882-3782-4edb-b107-59871e135126" status: 202 len: 0 microversion: 2.1 time: 0.332533 Oct 04 08:57:33.472732 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 358/713] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:57:33 2022] DELETE /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments/14538882-3782-4edb-b107-59871e135126 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:33.489180 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:33.491399 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:33.499436 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:33.499931 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:33.500602 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:33.501324 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:33.501818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:33.502254 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:33.532979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d0973768-04db-4a30-9b5c-f9584ffe9907 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055811 Oct 04 08:57:33.533528 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 356/714] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:33 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:34.547150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:34.549612 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:34.556471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:34.556959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:34.557393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:34.558086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:34.558579 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:34.558999 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:34.590512 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ccbfd0c2-eabc-482f-ac39-68ef300cc302 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048337 Oct 04 08:57:34.591289 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 359/715] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:34 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:35.603773 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:35.605851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:35.612162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:35.612646 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:35.613076 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:35.613766 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:35.614213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:35.614658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:35.644018 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-51fb2d66-9fd5-4cab-903b-4d574f25fd5c tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044916 Oct 04 08:57:35.644566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 357/716] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:35 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:57:35.723491 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:35.724054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:35.731200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:35.731908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:35.732534 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:35.733237 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:35.733697 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:35.734132 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:35.760570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:57:35.997266 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9c83b0cb-1d3e-42ff-a5a2-00bee19afc6f tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "DELETE /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 204 len: 0 microversion: 2.1 time: 0.281284 Oct 04 08:57:35.997860 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 360/717] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:57:35 2022] DELETE /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:57:36.005711 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:36.015448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:36.015448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:36.015448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:36.015448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:36.016042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:36.016042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:36.016042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:36.146224 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:36.154281 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e1cb459a-07ce-4a94-97dc-9c6252b1a42b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1690 microversion: 2.1 time: 0.152307 Oct 04 08:57:36.158882 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 358/718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:36 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:37.177748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:37.178394 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:37.185047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:37.185536 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:37.185978 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:37.186698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:37.187156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:37.187584 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:37.322072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:37.329947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ccaef651-2466-4291-8e67-d1943a52fafe tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1690 microversion: 2.1 time: 0.156577 Oct 04 08:57:37.330742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 361/719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:37 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:38.353590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:38.354263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:38.360709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.361196 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.361625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.362314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.362813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.363230 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.521638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:38.529867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-19af2bc8-3f32-4e45-87ac-32a8abfa8031 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1690 microversion: 2.1 time: 0.180711 Oct 04 08:57:38.530454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 359/720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:38 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:38.722158 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:38.724304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:38.730963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.731438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.731868 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.732553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.733003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.733421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.762619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-251d91f0-5a6a-42ad-bfb5-f92565d19892 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044148 Oct 04 08:57:38.763169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 362/721] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:38 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:57:38.825812 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:38.826376 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:38.832481 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.832962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.833397 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.834079 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:38.834566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:38.834992 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:38.860114 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:57:39.065942 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1fd1e6d4-f713-4d32-8079-d9be0ae1ea04 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 204 len: 0 microversion: 2.1 time: 0.244332 Oct 04 08:57:39.066615 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 360/722] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:57:38 2022] DELETE /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:57:39.075623 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:39.076233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:39.082250 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.082793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.083253 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.083941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.084388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.084806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.219553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:39.227531 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-76688208-e3c6-4472-a676-8e4d98ab4d05 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1672 microversion: 2.1 time: 0.156697 Oct 04 08:57:39.228755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 363/723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:39 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:39.553381 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:39.554160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:39.561351 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.561835 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.562269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.562981 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:39.563428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:39.563849 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:39.698685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:39.707612 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f1cfcd0d-9030-4849-b25e-5d7556d43714 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1690 microversion: 2.1 time: 0.158614 Oct 04 08:57:39.708485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 361/724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:39 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:40.252572 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:40.255085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:40.259627 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:40.260116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:40.260840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.262197 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:40.262685 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:40.263221 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.267473 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:40.631034 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:40.642604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-68a26808-aed0-43fe-8224-27919429eb59 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1672 microversion: 2.1 time: 0.391940 Oct 04 08:57:40.642604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 364/725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:40 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1672 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:40.732309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:40.732914 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:40.739271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:40.739765 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:40.740205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.741069 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:40.741535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:40.741965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:40.875921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:40.883642 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-38cda833-7513-44d1-b254-f3728a44fada tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1690 microversion: 2.1 time: 0.155967 Oct 04 08:57:40.884207 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 362/726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:40 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:41.664670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:41.665914 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:41.672892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.673606 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.674211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.675093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.675714 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.676279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.912419 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:41.913664 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:41.923878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.924756 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.925653 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.926807 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:41.927934 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:41.928672 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:41.940157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:41.949631 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-634b2d72-9947-444f-bdca-f63290ac37d8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1672 microversion: 2.1 time: 0.288139 Oct 04 08:57:41.950661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 365/727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:41 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1672 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:42.185890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:42.199273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-eb5e3eca-7fea-4c14-892a-646998e4f3bd tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1690 microversion: 2.1 time: 0.293959 Oct 04 08:57:42.200561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 363/728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:41 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:42.764607 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:42.765122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:42.772888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:42.774570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:42.775252 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:42.777038 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:42.777800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:42.778666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:42.806509 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b688d025-4ebd-4613-a557-8f69440dd7f9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/ips" status: 200 len: 151 microversion: 2.1 time: 0.360028 Oct 04 08:57:42.808343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 366/729] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:57:42 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/ips => generated 151 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:42.978392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:42.979051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:42.987382 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:42.987872 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:42.990750 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:42.991511 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:42.992149 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:42.992738 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.028795 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:43.238951 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-d16bf264-0cb0-434c-8a3b-8da97e9d54f8 req-1d73ca11-a337-49b8-8026-81b6a6139734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b087fca8-b245-4d5b-8cd3-1baec0ad7560", "name": "network-vif-deleted", "tag": "2689379b-47a8-42fb-97fd-2b3a41375c74"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:43.256899 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:43.259199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-d16bf264-0cb0-434c-8a3b-8da97e9d54f8 req-1d73ca11-a337-49b8-8026-81b6a6139734 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.265702 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-d16bf264-0cb0-434c-8a3b-8da97e9d54f8 req-1d73ca11-a337-49b8-8026-81b6a6139734 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.267616 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-d16bf264-0cb0-434c-8a3b-8da97e9d54f8 req-1d73ca11-a337-49b8-8026-81b6a6139734 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.278335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-77ad38ce-97be-44e7-803a-e16d48280e80 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1604 microversion: 2.1 time: 0.300075 Oct 04 08:57:43.279061 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 364/730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:42 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1604 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:43.329656 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-d16bf264-0cb0-434c-8a3b-8da97e9d54f8 req-1d73ca11-a337-49b8-8026-81b6a6139734 service nova] Creating event network-vif-deleted:2689379b-47a8-42fb-97fd-2b3a41375c74 for instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 on hv-cinder-85944 Oct 04 08:57:43.342435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-d16bf264-0cb0-434c-8a3b-8da97e9d54f8 req-1d73ca11-a337-49b8-8026-81b6a6139734 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246686 Oct 04 08:57:43.347933 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 367/731] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:43.359366 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:43.360143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:43.375250 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.377337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.377981 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.380201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.383496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.384551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.524609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:43.525199 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:43.548189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:43.571032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.571032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.571032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.571032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:43.571465 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:43.571465 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:43.571641 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-585b2372-df17-41e1-9a80-595d109f5e08 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1622 microversion: 2.1 time: 0.220824 Oct 04 08:57:43.573850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 368/732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:43 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1622 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:43.644168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-12376568-71d0-4f06-81fc-7243027b2f3c tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/ips" status: 200 len: 151 microversion: 2.20 time: 0.362759 Oct 04 08:57:43.666653 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 365/733] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Oct 4 08:57:43 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/ips => generated 151 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:57:44.305803 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:44.313742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:44.326080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.327817 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.328290 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.338136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.341313 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.342086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.388937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.389649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.390414 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.390981 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lazy-loading 'fault' on Instance uuid b087fca8-b245-4d5b-8cd3-1baec0ad7560 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:44.469353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:44.480714 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f396e58d-2b0b-4d9d-92f7-e4a042125275 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 200 len: 1326 microversion: 2.1 time: 0.178447 Oct 04 08:57:44.483422 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 369/734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:44 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 1326 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:44.605676 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:44.607030 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:44.630048 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.634042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.634042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.634042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.637114 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.639645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.707289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.710821 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.713475 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.715888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lazy-loading 'fault' on Instance uuid 836bad03-671e-48e3-8931-55435b0139d5 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:44.791037 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a388053c-f146-4e08-97cc-20a3c87c3726"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:44.794709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:44.814207 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.814737 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.815175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:44.815895 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:44.816349 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:44.816778 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.160433 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:45.170377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4a9e1e46-378b-4808-b86a-fa68b324d522 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 200 len: 1335 microversion: 2.1 time: 0.570269 Oct 04 08:57:45.186438 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 366/735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:44 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 1335 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:45.362667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-578e21a3-43b9-4972-92d5-c9eda8a8064a req-7a0b8ef3-2907-40c8-bfea-095857307cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836bad03-671e-48e3-8931-55435b0139d5", "name": "network-vif-deleted", "tag": "58411766-09ff-4773-bf48-970dc9dc8309"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:45.377895 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-578e21a3-43b9-4972-92d5-c9eda8a8064a req-7a0b8ef3-2907-40c8-bfea-095857307cea service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.382578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-578e21a3-43b9-4972-92d5-c9eda8a8064a req-7a0b8ef3-2907-40c8-bfea-095857307cea service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.383480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-578e21a3-43b9-4972-92d5-c9eda8a8064a req-7a0b8ef3-2907-40c8-bfea-095857307cea service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.405553 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-578e21a3-43b9-4972-92d5-c9eda8a8064a req-7a0b8ef3-2907-40c8-bfea-095857307cea service nova] Creating event network-vif-deleted:58411766-09ff-4773-bf48-970dc9dc8309 for instance 836bad03-671e-48e3-8931-55435b0139d5 on hv-cinder-85944 Oct 04 08:57:45.421597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-578e21a3-43b9-4972-92d5-c9eda8a8064a req-7a0b8ef3-2907-40c8-bfea-095857307cea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066524 Oct 04 08:57:45.422692 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 367/736] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:57:45.512883 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:45.513799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:45.520680 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.521397 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.522217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.523240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.523851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.524433 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.539556 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] HTTP exception thrown: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Request method failure captured: Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 HTTP/1.1 Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_SQzlLLavllRtBcvrWBzjOJWRRb54TycfEAh0sjfKqdy-lija3kmdvJRwB8ULeh6hPG4-zZsUMGAWHMVmunKTLXzY5-5oEVbX3WglKvdcntub-vqMELbCa7afezD9FsnfbYylu4xO9-0044r26ZGS5cIN5fdxkhng6SeuecOKdHbXc Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:57:45.541208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc8433b42fb74e8bbfef92acedf01259", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: cb93504f2605489eaf50cf10930b3e46 Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:57:45.542893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'b087fca8-b245-4d5b-8cd3-1baec0ad7560'} Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:45.543801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:57:45.545138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:57:45.547434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Returning 404 to user: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:45.548302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c2bc6e7d-cf75-4ebe-846e-a43bc1d19c08 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 404 len: 111 microversion: 2.1 time: 0.040712 Oct 04 08:57:45.552298 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 368/737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:45 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:57:45.557527 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0565496d-3534-431b-8954-fb30b279f804 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '.version_select at 0x7f6f1a339700>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:45.686758 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0565496d-3534-431b-8954-fb30b279f804 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386630108" status: 202 len: 0 microversion: 2.1 time: 0.133159 Oct 04 08:57:45.688457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 369/738] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Oct 4 08:57:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386630108 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:45.780680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a8931fcb-eec1-4544-8077-2278676b8aef tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.997030 Oct 04 08:57:45.783339 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 370/739] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:57:44 2022] POST /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments => generated 194 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:45.919921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:45.921033 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:45.934132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.935718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.936485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.937506 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:45.938186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:45.938817 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:45.974674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lazy-loading 'flavor' on Instance uuid feee8000-fafa-45b3-be22-370bb07f0c88 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:46.207087 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:46.207816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 836bad03-671e-48e3-8931-55435b0139d5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:46.235750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.236273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.236724 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.237742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.237961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.238474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.273331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] HTTP exception thrown: Instance 836bad03-671e-48e3-8931-55435b0139d5 could not be found. Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Request method failure captured: Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 HTTP/1.1 Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q8nvQCICfen3pq97UBwOKAMoZuSLY4oYNU1g1pfzcE7nSRmscvW6djdCBaFthjVByDfjI7bcnzGrhG0chZkiFXoV5uEzdauqf-NQNNqVkMZE8rIvPG2Ro5fFh5MoE5uvuaSXXp6IxgVox7YnOY7DKJ-fvcK4qinIf0Ca7fW_5aQVM Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:57:46.278705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b4590edfe642bc8a8bd15a1b8ba464", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 185e359e571f44bda1585124529b36a8 Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 836bad03-671e-48e3-8931-55435b0139d5 could not be found. Oct 04 08:57:46.282793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '836bad03-671e-48e3-8931-55435b0139d5'} Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836bad03-671e-48e3-8931-55435b0139d5 could not be found. Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:46.283857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836bad03-671e-48e3-8931-55435b0139d5 could not be found. Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836bad03-671e-48e3-8931-55435b0139d5 could not be found. Oct 04 08:57:46.285431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:46.287080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Returning 404 to user: Instance 836bad03-671e-48e3-8931-55435b0139d5 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:46.294164 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6877e3dc-4646-46d5-bc41-a7ac2570d519 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5" status: 404 len: 111 microversion: 2.1 time: 0.092472 Oct 04 08:57:46.299081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 371/740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:46 2022] GET /compute/v2.1/servers/836bad03-671e-48e3-8931-55435b0139d5 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:57:46.335434 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-89803579-a307-42f6-8704-c5e81b4a7071 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '.version_select at 0x7f6f1a400f70>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:46.490831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-89803579-a307-42f6-8704-c5e81b4a7071 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801306188" status: 202 len: 0 microversion: 2.1 time: 0.189040 Oct 04 08:57:46.491438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 372/741] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 4 08:57:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801306188 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:46.756985 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-86fa8d6b-29c7-4cf8-951b-9d4d477e3270 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/action" status: 202 len: 0 microversion: 2.20 time: 0.839002 Oct 04 08:57:46.758089 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 370/742] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 4 08:57:45 2022] POST /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:57:46.767574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:46.768212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:46.785029 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.788331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.788853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:46.789609 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:46.790245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:46.791069 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:47.185612 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:47.200815 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:47.207382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:47.207382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8cf459df-c39f-4219-9ebf-d95901053d1a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.440398 Oct 04 08:57:47.207382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 373/743] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:46 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:47.270913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-51c9c2b2-7ec3-4f5b-89f5-9376618dba0c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'create', calling method: .version_select at 0x7f6f1a39eca0>, body: {"keypair": {"name": "tempest-keypair-1200323699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMei2NOP7a0sxtyHTh4xJBqQbGDk+qHuAwz8p5NJ9b1saZHh8DPzYZGMjzhuUQ06UPeom3kbpuUbzhs6l01YulSKBgEgmJ3/f6oY1WrOq5W48KMSy+vW2cR3XQ82ytv+WA=="}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:47.292731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-51c9c2b2-7ec3-4f5b-89f5-9376618dba0c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Getting quotas for project bc8433b42fb74e8bbfef92acedf01259. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:57:47.297271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-51c9c2b2-7ec3-4f5b-89f5-9376618dba0c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Getting quotas for user cb93504f2605489eaf50cf10930b3e46 and project bc8433b42fb74e8bbfef92acedf01259. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:57:47.368654 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-51c9c2b2-7ec3-4f5b-89f5-9376618dba0c tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101638 Oct 04 08:57:47.369800 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 371/744] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:57:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:57:48.230946 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:48.231556 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:48.234224 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:48.239124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:48.239618 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:48.240057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:48.240896 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:48.242615 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:48.243038 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:48.417987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:48.427512 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:48.429081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:48.430269 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-df8ab788-2824-4210-bc64-42f30d4f2296 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.203464 Oct 04 08:57:48.430874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 374/745] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:48 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:49.459468 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:49.460283 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:49.470321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:49.476312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:49.476312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:49.476312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:49.476312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:49.476720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:49.701652 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:49.709875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:49.711373 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:49.712713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-52fdf3e3-41f5-4697-9175-24fa726513a1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.258076 Oct 04 08:57:49.713267 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 372/746] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:49 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:50.173538 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-86997272", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b69956c0-5fe6-4691-8a59-9cfb11ce6aa0"}], "security_groups": [{"name": "tempest-securitygroup--434708838"}], "key_name": "tempest-keypair-1200323699", "user_data": "}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:50.319517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] validate_networks() for [('b69956c0-5fe6-4691-8a59-9cfb11ce6aa0', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:57:50.478771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:50.481572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:50.484815 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:50.499187 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:50.500866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:50.501596 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:50.502617 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:50.503879 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:50.506070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:50.574714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:57:51.000805 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-154bfe7c-1783-4651-8952-0986740e23ef tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "DELETE /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 204 len: 0 microversion: 2.1 time: 0.522766 Oct 04 08:57:51.003902 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 373/747] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:57:50 2022] DELETE /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:57:51.017310 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:51.018382 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:51.029025 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:51.029405 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:57:51.029838 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:57:51.030171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:51.030323 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:57:51.030765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:57:51.031138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:51.031268 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:57:51.032144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:51.032949 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:51.033740 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:51.043109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:51.043360 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:51.043836 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:51.044685 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:51.045143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:51.045622 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:51.068332 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Getting quotas for project bc8433b42fb74e8bbfef92acedf01259. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:57:51.074240 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Getting quotas for user cb93504f2605489eaf50cf10930b3e46 and project bc8433b42fb74e8bbfef92acedf01259. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:57:51.115822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:57:51.121212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:57:51.247981 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:51.258207 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:51.262328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:51.263658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-726b2baa-2fcb-4c1f-ac36-220045355f79 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.258368 Oct 04 08:57:51.264650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 374/748] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:51 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:51.270240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:51.271083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:51.277562 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:51.278305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:51.278936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:51.279844 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:51.280480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:51.281059 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:51.346116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3ec6d60b-8a7c-4ff5-9c6e-60305556a784 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.182336 Oct 04 08:57:51.350064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 375/749] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:57:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:57:51.362768 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e1b803bc-96f6-4756-8b22-b04b26d43407 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:51.364284 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e1b803bc-96f6-4756-8b22-b04b26d43407 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:51.464406 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e1b803bc-96f6-4756-8b22-b04b26d43407 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:51.472206 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e1b803bc-96f6-4756-8b22-b04b26d43407 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1236 microversion: 2.1 time: 0.114313 Oct 04 08:57:51.476530 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 376/750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:51 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1236 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:51.523718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:51.541309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0135569e-94b7-4d36-9cfc-5cbd66f0f637 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1508 microversion: 2.1 time: 0.275344 Oct 04 08:57:51.541896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 375/751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:51 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:52.296546 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:52.297399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:52.305610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:52.307116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:52.308312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:52.309395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:52.310027 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:52.311129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:52.508089 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:52.508089 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:52.519689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:52.520147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:52.521020 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:52.521688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:52.522718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:52.523554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:52.524206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:52.533370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:52.536170 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:52.539522 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-91433e2a-29f0-43de-abf5-5859d07d1578 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.248199 Oct 04 08:57:52.540646 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 377/752] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:52 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:52.582736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:52.583370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:52.597045 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:52.597630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:52.598077 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:52.598853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:52.599316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:52.599975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:52.615810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:52.624077 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-39814eb2-d5fb-48e1-b28a-272a2bff093a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1240 microversion: 2.1 time: 0.126166 Oct 04 08:57:52.650189 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 376/753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:52 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1240 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:52.782450 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:52.816005 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e8dfeb10-9677-4804-9389-a698c8857705 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1508 microversion: 2.1 time: 0.252597 Oct 04 08:57:52.818784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 378/754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:52 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:53.567348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:53.568796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:53.580294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:53.581004 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:53.582869 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:53.584957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:53.584957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:53.585751 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:53.653839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:53.656053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:53.677383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:53.684200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:53.684809 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:53.686117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:53.687801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:53.688234 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:53.844284 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:53.851497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:53.852425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-50bc8dd4-86ee-4acb-a40d-d096daf78b78 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1288 microversion: 2.1 time: 0.207942 Oct 04 08:57:53.853528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 379/755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:53 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1288 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:53.858513 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-3fcbbab4-92b0-4e21-815c-71a10b1ba3bd req-076b3c82-e67c-49a1-953b-7cd5f9bb5741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77980831-3790-419c-be64-5c42d888ff49", "name": "network-vif-deleted", "tag": "ff4cfcd1-064d-4a58-a5bd-20180f00f6f5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:53.868401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-3fcbbab4-92b0-4e21-815c-71a10b1ba3bd req-076b3c82-e67c-49a1-953b-7cd5f9bb5741 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:53.869091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-3fcbbab4-92b0-4e21-815c-71a10b1ba3bd req-076b3c82-e67c-49a1-953b-7cd5f9bb5741 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:53.869701 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-3fcbbab4-92b0-4e21-815c-71a10b1ba3bd req-076b3c82-e67c-49a1-953b-7cd5f9bb5741 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:53.874673 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:53.880999 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:53.880999 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-944bf649-3aa3-44ac-84f7-86271fd6d49b tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.314385 Oct 04 08:57:53.880999 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 377/756] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:53 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:53.882814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-3fcbbab4-92b0-4e21-815c-71a10b1ba3bd req-076b3c82-e67c-49a1-953b-7cd5f9bb5741 service nova] Creating event network-vif-deleted:ff4cfcd1-064d-4a58-a5bd-20180f00f6f5 for instance 77980831-3790-419c-be64-5c42d888ff49 on hv-cinder-85944 Oct 04 08:57:53.883961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:53.884569 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:53.889942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-3fcbbab4-92b0-4e21-815c-71a10b1ba3bd req-076b3c82-e67c-49a1-953b-7cd5f9bb5741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035063 Oct 04 08:57:53.891006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 380/757] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:53.896349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:53.897022 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:53.897621 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:53.898650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:53.899157 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:53.899581 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:54.237944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:54.242956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-236bfc82-cc6d-43b3-9f60-dfafafc40f1d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 200 len: 1466 microversion: 2.1 time: 0.362741 Oct 04 08:57:54.243543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 378/758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:53 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 1466 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:54.677140 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a388053c-f146-4e08-97cc-20a3c87c3726"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:54.685552 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:54.696108 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:54.699174 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:54.700260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:54.701209 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:54.702975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:54.706373 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:54.833705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Invalid volume: volume a388053c-f146-4e08-97cc-20a3c87c3726 is already attached to instances: 01deb208-ffd0-4664-90dc-aca0a3fff70e Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: POST /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments HTTP/1.1 Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 74 Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:57:54.835673 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {"volumeAttachment": {"volumeId": "a388053c-f146-4e08-97cc-20a3c87c3726"}} Oct 04 08:57:54.836942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Invalid volume: volume a388053c-f146-4e08-97cc-20a3c87c3726 is already attached to instances: 01deb208-ffd0-4664-90dc-aca0a3fff70e Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'server_id': '01deb208-ffd0-4664-90dc-aca0a3fff70e', 'body': {'volumeAttachment': {'volumeId': 'a388053c-f146-4e08-97cc-20a3c87c3726'}}} Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a388053c-f146-4e08-97cc-20a3c87c3726 is already attached to instances: 01deb208-ffd0-4664-90dc-aca0a3fff70e Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:54.837638 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a388053c-f146-4e08-97cc-20a3c87c3726 is already attached to instances: 01deb208-ffd0-4664-90dc-aca0a3fff70e Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:54.839852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:54.841157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:54.841157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:54.841157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:54.841157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a388053c-f146-4e08-97cc-20a3c87c3726 is already attached to instances: 01deb208-ffd0-4664-90dc-aca0a3fff70e Oct 04 08:57:54.841157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:54.841157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 400 to user: Invalid volume: volume a388053c-f146-4e08-97cc-20a3c87c3726 is already attached to instances: 01deb208-ffd0-4664-90dc-aca0a3fff70e {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:54.841157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9b044221-ed9b-4c2b-bd6e-f1bbf5ece0b5 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174583 Oct 04 08:57:54.841157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 381/759] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:57:54 2022] POST /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments => generated 174 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:57:54.879937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:54.880553 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:54.889530 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:54.890034 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:54.892849 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:54.893598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:54.894125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:54.896748 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:54.906028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:54.906740 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:54.919582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:54.920102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:54.921206 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:54.921945 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:54.922831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:54.924027 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.027387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:55.036682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-56d68711-cf5a-4fe5-9bb1-d90c2d4106d1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1294 microversion: 2.1 time: 0.161564 Oct 04 08:57:55.048210 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 379/760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:54 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1294 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:55.058598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:55.059358 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:55.066802 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.067583 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.068201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.069075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.069699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.070294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.095421 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:55.241296 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'services' on Instance uuid 01deb208-ffd0-4664-90dc-aca0a3fff70e {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:57:55.325281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:55.334386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:55.345071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:55.346284 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-78c19e07-c318-4e9f-9ef2-aa71cdd44523 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.445133 Oct 04 08:57:55.347072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 382/761] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:54 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:57:55.368659 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:55.372393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 77980831-3790-419c-be64-5c42d888ff49] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:55.385582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.387128 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.387524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.388262 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.393063 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.396655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.415579 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] HTTP exception thrown: Instance 77980831-3790-419c-be64-5c42d888ff49 could not be found. Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Request method failure captured: Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 HTTP/1.1 Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q8nvQCICfen3pq97UBwOKAMoZuSLY4oYNU1g1pfzcE7nSRmscvW6djdCBaFthjVByDfjI7bcnzGrhG0chZkiFXoV5uEzdauqf-NQNNqVkMZE8rIvPG2Ro5fFh5MoE5uvuaSXXp6IxgVox7YnOY7DKJ-fvcK4qinIf0Ca7fW_5aQVM Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:57:55.418080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b4590edfe642bc8a8bd15a1b8ba464", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 185e359e571f44bda1585124529b36a8 Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 77980831-3790-419c-be64-5c42d888ff49 could not be found. Oct 04 08:57:55.419463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '77980831-3790-419c-be64-5c42d888ff49'} Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77980831-3790-419c-be64-5c42d888ff49 could not be found. Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:57:55.420155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77980831-3790-419c-be64-5c42d888ff49 could not be found. Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77980831-3790-419c-be64-5c42d888ff49 could not be found. Oct 04 08:57:55.421277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:57:55.422389 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Returning 404 to user: Instance 77980831-3790-419c-be64-5c42d888ff49 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:57:55.422389 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6330561b-af48-4639-a65d-49f3209e90db tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49" status: 404 len: 111 microversion: 2.1 time: 0.059828 Oct 04 08:57:55.423769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 383/762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:55 2022] GET /compute/v2.1/servers/77980831-3790-419c-be64-5c42d888ff49 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:57:55.428869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:55.431099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:55.438934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.439517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.440230 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.441199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.441813 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.442240 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.475009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:57:55.478023 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:55.593391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0d5697de-991d-40a8-9cfe-e490d8aff981 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments/a388053c-f146-4e08-97cc-20a3c87c3726" status: 202 len: 0 microversion: 2.1 time: 0.543308 Oct 04 08:57:55.594467 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 380/763] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:57:55 2022] DELETE /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments/a388053c-f146-4e08-97cc-20a3c87c3726 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:57:55.606213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:55.608987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:55.618426 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.619239 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.619903 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.621780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.623117 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.642365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.720060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5ad1951e-c154-4689-b8e8-d718585842bb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121163 Oct 04 08:57:55.741670 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 381/764] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:55 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:55.875328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-56ab73dc-f5dc-4b18-9a77-193ab48e42a9 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "DELETE /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 204 len: 0 microversion: 2.1 time: 0.449938 Oct 04 08:57:55.884522 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:55.885297 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 384/765] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:57:55 2022] DELETE /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:57:55.885561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:55.894031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.894994 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.895789 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:55.896825 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:55.897456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:55.898226 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:56.070477 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:56.070477 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:56.074381 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:56.074953 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:56.075391 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:56.076113 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:56.076578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:56.077011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:56.250374 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:56.259830 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a8e60b68-2a05-4a12-9c31-9e1bf4ee416d tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.378833 Oct 04 08:57:56.261636 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 382/766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:55 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:56.348523 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:56.357506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-57b25123-9112-4827-b63a-58dfc3fc7609 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.297758 Oct 04 08:57:56.360280 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 385/767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:56 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:57:56.377743 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:56.378711 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:56.385084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:56.386143 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:56.386620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:56.387325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:56.388036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:56.388689 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:56.534682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:56.543950 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:56.545684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:56.547250 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-3ef30d54-cba2-4522-bdf3-c0f34ed02e1d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.173440 Oct 04 08:57:56.554875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 383/768] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:56 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:56.716866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6b7413d6-bb5b-46ad-a7da-f3bdc0ed3bcf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Action: 'create', calling method: .version_select at 0x7f6f1a35aee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-868131196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCp6tVMkbrX0d89o8FSaKnVobjZSmCVfIgtUhAIZciPpOX2DeDMqiVcnac4CDpYu22Sy8i+r68OfSKb+DM7ROkhi3kGyjRvv4EiY89XCsZCQTZGQRJ+2s7aTjDKUngCS8w=="}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:56.732511 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-6b7413d6-bb5b-46ad-a7da-f3bdc0ed3bcf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Getting quotas for project 655f83bbd3d847f3b060af2ff5250585. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:57:56.736312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-6b7413d6-bb5b-46ad-a7da-f3bdc0ed3bcf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Getting quotas for user faa4a1f5f6954d92830b7df74952161e and project 655f83bbd3d847f3b060af2ff5250585. Resources: {'key_pairs'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:57:56.753117 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:56.755449 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:56.761902 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:56.772098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:56.772098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:56.772098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:56.772098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:56.772463 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:56.795643 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7e313495-5f06-4460-b080-201a8f411ffb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046303 Oct 04 08:57:56.796219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 384/769] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:56 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:57:56.828011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6b7413d6-bb5b-46ad-a7da-f3bdc0ed3bcf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.271647 Oct 04 08:57:56.828635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 386/770] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:57:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:57:57.283435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:57.284059 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:57.290424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:57.290945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:57.291384 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:57.293245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:57.293793 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:57.294229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:57.312359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=4 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:57.382129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:57.382875 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:57.394527 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:57.394972 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:57.395501 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:57.396443 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:57.396905 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:57.397361 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:57.486484 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:57.494540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-172e3ee9-0b16-46b3-a9ef-f994150e6c93 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.214885 Oct 04 08:57:57.495732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 385/771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:57 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:57.552277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:57.561550 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-cc25a3c5-34d6-4ad7-afa0-0d2cb5bbeab6 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.183087 Oct 04 08:57:57.562175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 387/772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:57 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:57.579500 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:57.580104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:57.586287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:57.586801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:57.587285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:57.587977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:57.588424 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:57.589366 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:57.724791 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:57.739603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:57.739603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:57.739603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f86328e0-6139-4a48-ab0b-5d1fb0051383 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.160640 Oct 04 08:57:57.739897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 386/773] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:57 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:57.808382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:57.810608 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:57.817052 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:57.820583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:57.820583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:57.820583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:57.820583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:57.821055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:57.851002 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-007f4bf2-29bd-40ed-aea9-8ed913ce1933 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046963 Oct 04 08:57:57.851594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 388/774] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:57 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:57:58.518508 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:58.519127 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:58.526956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:58.527550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:58.528145 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:58.528846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:58.529475 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:58.530056 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:58.590939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:58.594275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:58.610805 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:58.611900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:58.614776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:58.616299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:58.618488 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:58.619161 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:58.750708 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:58.763577 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9ebc8d21-2d7d-460c-bc59-78ac05c962d3 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1522 microversion: 2.1 time: 0.247679 Oct 04 08:57:58.769201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 387/775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:58 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:58.776285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:58.779584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:58.792042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:58.793350 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:58.793958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:58.797684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:58.797684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:58.797684 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:58.880394 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:58.892482 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8049caa6-ede7-4296-b646-e1fcef61e4a0 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.308625 Oct 04 08:57:58.893434 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 389/776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:58 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:58.898837 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:58.901171 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:58.908802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:58.909298 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:58.909799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:58.911173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:58.911630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:58.912045 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:58.969211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6b102aee-e930-4710-9edb-67526a3ea045 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074422 Oct 04 08:57:58.970530 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 390/777] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:57:58 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:57:59.044764 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:59.045553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:59.055488 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.056847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.057624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:59.058526 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.061238 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.062588 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:59.098919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:59.107504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:59.109202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:59.109753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:57:59.110379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-da0e0ecc-4eb4-47f6-9962-7d900a0c45ca tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1741 microversion: 2.20 time: 0.344599 Oct 04 08:57:59.122601 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 388/778] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:57:58 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1741 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:57:59.280097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-352c007d-af87-4d8e-9905-9a9e58eb163a req-8dd14a31-d987-4008-a11f-25fe2f5922c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07087473-a629-4720-abc6-c514a5120511", "name": "network-vif-deleted", "tag": "3204e9c4-8fba-47f2-b86e-dfd24301d3c6"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:57:59.302694 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-352c007d-af87-4d8e-9905-9a9e58eb163a req-8dd14a31-d987-4008-a11f-25fe2f5922c9 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.303328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-352c007d-af87-4d8e-9905-9a9e58eb163a req-8dd14a31-d987-4008-a11f-25fe2f5922c9 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.304029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-352c007d-af87-4d8e-9905-9a9e58eb163a req-8dd14a31-d987-4008-a11f-25fe2f5922c9 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:59.317848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-352c007d-af87-4d8e-9905-9a9e58eb163a req-8dd14a31-d987-4008-a11f-25fe2f5922c9 service nova] Creating event network-vif-deleted:3204e9c4-8fba-47f2-b86e-dfd24301d3c6 for instance 07087473-a629-4720-abc6-c514a5120511 on hv-cinder-85944 Oct 04 08:57:59.326924 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-352c007d-af87-4d8e-9905-9a9e58eb163a req-8dd14a31-d987-4008-a11f-25fe2f5922c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048945 Oct 04 08:57:59.328014 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 389/779] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:57:59.427703 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-278720de-f8a6-44b6-a42b-5a2295610d69 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 204 len: 0 microversion: 2.1 time: 0.385931 Oct 04 08:57:59.432061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 391/780] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:57:59 2022] DELETE /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:57:59.439051 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:59.439860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:59.449088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.449913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.450592 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:59.452683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.453927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.454635 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:59.632213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:59.650696 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1b851e74-fe3e-4517-912e-1a7a5a2a6a88 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1684 microversion: 2.1 time: 0.207463 Oct 04 08:57:59.650696 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 390/781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:59 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1684 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:59.804156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:59.807127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:59.816317 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.817483 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.818379 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:59.819405 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.819929 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.820580 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:59.902228 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:57:59.911535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1c3a1c27-02a5-46f7-b5da-7ece03d98c0e tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1306 microversion: 2.1 time: 0.120420 Oct 04 08:57:59.914522 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 392/782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:59 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1306 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:57:59.923382 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:57:59.924328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:57:59.933212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.933725 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.934287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:57:59.935027 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:57:59.935623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:57:59.936284 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:00.079867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:00.087940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f4f2191e-2d91-4ab9-ac55-3c3253c0eb90 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.168311 Oct 04 08:58:00.088526 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 391/783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:57:59 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:00.138280 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:00.138926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:00.145409 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:00.145932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:00.146447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:00.147156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:00.147618 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:00.148051 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:00.314232 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:00.324107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:00.325849 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:00.327311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-54ef6a8c-c258-4bca-9333-afc2ccc44576 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1741 microversion: 2.20 time: 0.194063 Oct 04 08:58:00.328414 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 393/784] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:00 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:00.672191 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:00.673412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:00.690083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:00.690614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:00.691061 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:00.691881 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:00.692344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:00.692779 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:00.840507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:00.849574 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0b7f3248-30df-4a17-aec5-3782f12f57eb tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1684 microversion: 2.1 time: 0.181956 Oct 04 08:58:00.850204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 392/785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:00 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:00.938153 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:00.939798 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:00.947871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:00.949131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:00.949894 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:00.950657 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:00.951127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:00.951561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:00.986826 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:00.987315 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:00.987756 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:00.988208 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lazy-loading 'fault' on Instance uuid 07087473-a629-4720-abc6-c514a5120511 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:58:01.030629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:01.039285 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1ccdeb6b-d6fc-4e50-b711-00318b694d72 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1311 microversion: 2.1 time: 0.107493 Oct 04 08:58:01.039863 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 394/786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:00 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:01.117393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:01.117965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:01.128860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:01.129350 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:01.129784 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:01.130524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:01.131052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:01.137082 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:01.369142 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:01.369142 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:01.369142 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:01.384642 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:01.388951 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:01.389342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:01.390102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:01.396773 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:01.398750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:01.420937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:01.437929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d3f5da8d-e90d-48f7-9c9a-8b59ee418608 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.324880 Oct 04 08:58:01.437929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 393/787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:01 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:01.441193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-5852de0d-38d7-43b7-8d72-063bc30a5586 req-42fd5b9f-957e-46a5-8766-50ec459224f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d632ced-345e-4586-9a9c-45f3fa279017", "tag": "40e61ddb-9135-44a4-af4c-083b3ed0acba"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:01.460787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-5852de0d-38d7-43b7-8d72-063bc30a5586 req-42fd5b9f-957e-46a5-8766-50ec459224f7 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:01.460787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-5852de0d-38d7-43b7-8d72-063bc30a5586 req-42fd5b9f-957e-46a5-8766-50ec459224f7 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:01.460787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-5852de0d-38d7-43b7-8d72-063bc30a5586 req-42fd5b9f-957e-46a5-8766-50ec459224f7 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:01.490197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-5852de0d-38d7-43b7-8d72-063bc30a5586 req-42fd5b9f-957e-46a5-8766-50ec459224f7 service nova] Creating event network-changed:40e61ddb-9135-44a4-af4c-083b3ed0acba for instance 8d632ced-345e-4586-9a9c-45f3fa279017 on hv-cinder-85944 Oct 04 08:58:01.499671 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-5852de0d-38d7-43b7-8d72-063bc30a5586 req-42fd5b9f-957e-46a5-8766-50ec459224f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063915 Oct 04 08:58:01.500477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 394/788] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:01.581799 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:01.592130 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:01.593572 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:01.594832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3a381b01-9888-4d8f-ab3c-3cc8058120e6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.245705 Oct 04 08:58:01.596999 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 395/789] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:01 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:01.873530 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:01.874238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:01.880451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:01.880937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:01.881377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:01.882093 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:01.882561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:01.882986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:02.045116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:02.054318 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cbbeefb8-205e-41a0-8228-32841ddda79c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1684 microversion: 2.1 time: 0.185669 Oct 04 08:58:02.055030 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 395/790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:01 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:02.063208 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:02.063911 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:02.070323 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:02.071054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:02.071488 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:02.072179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:02.072629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:02.073048 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:02.113453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:02.114193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:02.114970 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:02.115428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lazy-loading 'fault' on Instance uuid 07087473-a629-4720-abc6-c514a5120511 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:58:02.160486 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185e359e571f44bda1585124529b36a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4590edfe642bc8a8bd15a1b8ba464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:02.168614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-af3f8219-9510-4761-862c-a5162c7d4320 tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 200 len: 1311 microversion: 2.1 time: 0.109171 Oct 04 08:58:02.169274 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 396/791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:02 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:02.459433 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:02.460056 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:02.469921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:02.472088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:02.472756 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:02.473502 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:02.473970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:02.478723 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:02.628331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:02.629125 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:02.635149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:02.637772 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:02.638594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:02.639502 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:02.641211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:02.642095 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:02.682067 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:02.705365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0a4e8d5a-572a-45fe-9919-b1191ef514c1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.247799 Oct 04 08:58:02.707701 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 396/792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:02 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:02.974993 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:02.990018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:02.992090 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:02.994052 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4f11b8cc-5c35-45d1-9dcb-1803c05ca271 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.370162 Oct 04 08:58:02.997569 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 397/793] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:02 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:03.077669 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:03.080147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:03.086966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.091051 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.091955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.094900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.095744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-8fcd710a-0a33-4847-bf34-9fba9403df84 req-8b44430e-e5ad-4545-9833-bfafbe37d9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feee8000-fafa-45b3-be22-370bb07f0c88", "name": "network-vif-plugged", "status": "completed", "tag": "7224ed3c-c9cb-445e-bb2f-be715b606313"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:03.096820 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.098192 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.119537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8fcd710a-0a33-4847-bf34-9fba9403df84 req-8b44430e-e5ad-4545-9833-bfafbe37d9a8 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.120256 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8fcd710a-0a33-4847-bf34-9fba9403df84 req-8b44430e-e5ad-4545-9833-bfafbe37d9a8 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.120973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-8fcd710a-0a33-4847-bf34-9fba9403df84 req-8b44430e-e5ad-4545-9833-bfafbe37d9a8 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.149816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:03.172601 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-8fcd710a-0a33-4847-bf34-9fba9403df84 req-8b44430e-e5ad-4545-9833-bfafbe37d9a8 service nova] Creating event network-vif-plugged:7224ed3c-c9cb-445e-bb2f-be715b606313 for instance feee8000-fafa-45b3-be22-370bb07f0c88 on hv-cinder-85944 Oct 04 08:58:03.177984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.184126 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-8fcd710a-0a33-4847-bf34-9fba9403df84 req-8b44430e-e5ad-4545-9833-bfafbe37d9a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243036 Oct 04 08:58:03.185035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 397/794] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:03.188582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.189622 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.190888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid 01deb208-ffd0-4664-90dc-aca0a3fff70e {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:58:03.197620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:03.199385 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] [instance: 07087473-a629-4720-abc6-c514a5120511] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:03.206837 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.207702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.208240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.209249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.209860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.210477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.232752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] HTTP exception thrown: Instance 07087473-a629-4720-abc6-c514a5120511 could not be found. Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Request method failure captured: Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 HTTP/1.1 Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q8nvQCICfen3pq97UBwOKAMoZuSLY4oYNU1g1pfzcE7nSRmscvW6djdCBaFthjVByDfjI7bcnzGrhG0chZkiFXoV5uEzdauqf-NQNNqVkMZE8rIvPG2Ro5fFh5MoE5uvuaSXXp6IxgVox7YnOY7DKJ-fvcK4qinIf0Ca7fW_5aQVM Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:58:03.234659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b4590edfe642bc8a8bd15a1b8ba464", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b4590edfe642bc8a8bd15a1b8ba464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 24b4590edfe642bc8a8bd15a1b8ba464 Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1626497698 Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 185e359e571f44bda1585124529b36a8 Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1626497698-project Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 07087473-a629-4720-abc6-c514a5120511 could not be found. Oct 04 08:58:03.235983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '07087473-a629-4720-abc6-c514a5120511'} Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07087473-a629-4720-abc6-c514a5120511 could not be found. Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:58:03.236703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07087473-a629-4720-abc6-c514a5120511 could not be found. Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07087473-a629-4720-abc6-c514a5120511 could not be found. Oct 04 08:58:03.237870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:58:03.240806 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] Returning 404 to user: Instance 07087473-a629-4720-abc6-c514a5120511 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:58:03.240954 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:03.241659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-88e38561-6955-4ee6-956f-6bb73f00d02b tempest-ServerRescueNegativeTestJSON-1626497698 tempest-ServerRescueNegativeTestJSON-1626497698-project] 10.222.0.27 "GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511" status: 404 len: 111 microversion: 2.1 time: 0.051855 Oct 04 08:58:03.242623 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 398/795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:03 2022] GET /compute/v2.1/servers/07087473-a629-4720-abc6-c514a5120511 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:58:03.254196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a17cdaf0-f0d0-42a4-ba87-cdea7524b2ca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1332 microversion: 2.1 time: 0.180138 Oct 04 08:58:03.254699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 398/796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:03 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:03.733979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:03.734799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:03.741418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.742253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.742835 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.746098 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.746633 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.747097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.752755 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:03.828598 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-5dcc33dd-63b2-4879-a593-d9fe0c99515f req-43bbd9ae-1798-4993-a27f-5cc4c629d766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01deb208-ffd0-4664-90dc-aca0a3fff70e", "name": "network-vif-deleted", "tag": "3f7e3944-8bfb-4131-9b47-16932063c516"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:03.843855 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5dcc33dd-63b2-4879-a593-d9fe0c99515f req-43bbd9ae-1798-4993-a27f-5cc4c629d766 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:03.844692 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5dcc33dd-63b2-4879-a593-d9fe0c99515f req-43bbd9ae-1798-4993-a27f-5cc4c629d766 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:03.845309 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5dcc33dd-63b2-4879-a593-d9fe0c99515f req-43bbd9ae-1798-4993-a27f-5cc4c629d766 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:03.861488 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-5dcc33dd-63b2-4879-a593-d9fe0c99515f req-43bbd9ae-1798-4993-a27f-5cc4c629d766 service nova] Creating event network-vif-deleted:3f7e3944-8bfb-4131-9b47-16932063c516 for instance 01deb208-ffd0-4664-90dc-aca0a3fff70e on hv-cinder-85944 Oct 04 08:58:03.866631 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-5dcc33dd-63b2-4879-a593-d9fe0c99515f req-43bbd9ae-1798-4993-a27f-5cc4c629d766 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041952 Oct 04 08:58:03.867488 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 399/797] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:03.992503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:04.001662 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-130cece2-851a-4317-ac67-dae259fae688 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.272600 Oct 04 08:58:04.003100 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 399/798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:03 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:04.027197 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:04.027910 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:04.035869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:04.036357 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:04.036794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:04.037689 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:04.038146 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:04.038604 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:04.278541 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:04.280383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:04.289946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:04.290796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:04.292997 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:04.293979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:04.295858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:04.296473 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:04.441636 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:04.455510 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:04.457453 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:04.459245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3cb47998-ee01-48e6-954d-9bad2b09a3d4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.437174 Oct 04 08:58:04.480448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 400/799] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:04 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:04.624053 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:04.624850 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:04.625450 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:04.626387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid 01deb208-ffd0-4664-90dc-aca0a3fff70e {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:58:04.694024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:04.718367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9029e041-83c3-49d5-b690-dd111c1617db tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 200 len: 1332 microversion: 2.1 time: 0.444896 Oct 04 08:58:04.735567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 400/800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:04 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 1332 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:05.026196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:05.027861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:05.038193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:05.040225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:05.040956 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:05.041402 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:05.042175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:05.045980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:05.046779 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:05.232560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:05.242484 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-63e5dc94-839e-4ac9-a88c-cce5b02544c2 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.220592 Oct 04 08:58:05.261667 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 401/801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:05 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:05.489259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:05.489900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:05.497950 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:05.498464 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:05.498905 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:05.499606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:05.500065 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:05.500492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:05.670977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:05.686019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:05.687776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:05.689733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-af397c55-bd0a-4fe3-b7d3-e8ae90e466e1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.203806 Oct 04 08:58:05.713066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 401/802] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:05 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:05.751025 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:05.756078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:05.766665 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:05.768468 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:05.769134 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:05.770567 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:05.771231 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:05.771912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:05.793478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e HTTP/1.1 Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:58:05.795684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:58:05.797019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '01deb208-ffd0-4664-90dc-aca0a3fff70e'} Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:58:05.797824 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:58:05.799094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:05.802508 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:58:05.803845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4fde6842-c7f0-44a7-81c9-47576d635983 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 404 len: 111 microversion: 2.1 time: 0.062391 Oct 04 08:58:05.804694 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 402/803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:05 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:58:05.815454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0c64ef83-8924-464f-a381-139f6c22a314 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '.version_select at 0x7f6f1a352310>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:05.897232 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0c64ef83-8924-464f-a381-139f6c22a314 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996255650" status: 202 len: 0 microversion: 2.1 time: 0.087456 Oct 04 08:58:05.901198 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 402/804] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 4 08:58:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996255650 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:58:06.275961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:06.280027 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:06.288701 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:06.289914 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:06.290573 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:06.291444 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:06.303147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:06.304665 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:06.725465 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:06.727836 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:06.737744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:06.739426 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:06.740055 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:06.741035 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:06.742017 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:06.743173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=12 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:06.744830 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:06.788275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:06.822020 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-443c8e1f-b27b-4a8d-8875-484e10edac50 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.554263 Oct 04 08:58:06.828753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 403/805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:06 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:07.084428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-9fcec59f-8c04-4f72-a8c3-4cfefac91a13 req-3f2677d1-d695-4f18-b1cf-19d3c75039c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d632ced-345e-4586-9a9c-45f3fa279017", "name": "network-vif-plugged", "status": "completed", "tag": "40e61ddb-9135-44a4-af4c-083b3ed0acba"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:07.126922 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9fcec59f-8c04-4f72-a8c3-4cfefac91a13 req-3f2677d1-d695-4f18-b1cf-19d3c75039c0 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:07.127979 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9fcec59f-8c04-4f72-a8c3-4cfefac91a13 req-3f2677d1-d695-4f18-b1cf-19d3c75039c0 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:07.128573 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9fcec59f-8c04-4f72-a8c3-4cfefac91a13 req-3f2677d1-d695-4f18-b1cf-19d3c75039c0 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:07.166107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-9fcec59f-8c04-4f72-a8c3-4cfefac91a13 req-3f2677d1-d695-4f18-b1cf-19d3c75039c0 service nova] Creating event network-vif-plugged:40e61ddb-9135-44a4-af4c-083b3ed0acba for instance 8d632ced-345e-4586-9a9c-45f3fa279017 on hv-cinder-85944 Oct 04 08:58:07.175131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-9fcec59f-8c04-4f72-a8c3-4cfefac91a13 req-3f2677d1-d695-4f18-b1cf-19d3c75039c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093914 Oct 04 08:58:07.177994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 404/806] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:58:07.508456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:07.530680 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:07.532760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:07.534622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7a9895dc-e0fc-4d35-8253-4aed9f00c979 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.817342 Oct 04 08:58:07.538709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 403/807] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:06 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:07.865309 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:07.866316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:07.885560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:07.891185 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:07.891724 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:07.892469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:07.892932 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:07.893363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:08.131906 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4ea643a3-0ee7-42ad-a010-26dcd19c7466 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: .version_select at 0x7f6f1a3fc310>, body: {"keypair": {"name": "tempest-keypair-1031719879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNohcMvVhpR1ouFdAdLN7Uf4STwoFNW0jPEfDyDzRdAp7Zc08b6+UHfBHXvbgjYIpVB3IqU5XMcI5NWUD3K3Cmm/lQFuW4Lj8mc4cLLtY1ZSsG4kP9n5y3/NsdEoTuMAg=="}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:08.167755 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-4ea643a3-0ee7-42ad-a010-26dcd19c7466 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for project 8760be982f804a9aa319b989aa1c3118. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:58:08.187382 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-4ea643a3-0ee7-42ad-a010-26dcd19c7466 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for user 14d56042415540a3b3ed06578b712ca5 and project 8760be982f804a9aa319b989aa1c3118. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:58:08.271592 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:08.273553 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4ea643a3-0ee7-42ad-a010-26dcd19c7466 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149288 Oct 04 08:58:08.279093 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 404/808] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 08:58:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:08.281072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1cb15e41-f564-44db-8f3b-22745ea5ecd3 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.427248 Oct 04 08:58:08.284542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 405/809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:07 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:08.566764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:08.567396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:08.574149 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:08.574675 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:08.575118 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:08.576198 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:08.576658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:08.577085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:08.806267 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:08.806267 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:08.806509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:08.806509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-86f5ae5c-d503-4a13-ad36-086c5a7a0747 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.184217 Oct 04 08:58:08.806509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 405/810] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:08 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:09.304442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:09.305797 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:09.319053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:09.319784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:09.321653 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:09.322814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:09.323890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:09.325668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:09.610232 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:09.620240 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-12f607e7-6e72-4e97-a78f-1dd9472ec564 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1361 microversion: 2.1 time: 0.320002 Oct 04 08:58:09.621574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 406/811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:09 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:09.775477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:09.777023 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:09.820140 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:09.823107 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:09.824002 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:09.825137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:09.828454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:09.830029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:10.148221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:10.158394 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:10.160024 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:10.161053 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b0880c9d-33d5-4746-9ad0-28b4367abd96 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.389695 Oct 04 08:58:10.161801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 406/812] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:09 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:10.644550 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:10.645156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:10.654820 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:10.659987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:10.661784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:10.665866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:10.673785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:10.673785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:10.947418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:10.970445 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f99beac7-bfeb-4510-8fdb-e2981de0e8ed tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1547 microversion: 2.1 time: 0.329459 Oct 04 08:58:10.977600 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 407/813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:10 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1547 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:11.002219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:11.003652 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:11.014802 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:11.015658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:11.016192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:11.016992 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:11.017626 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:11.018149 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:11.177616 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0beec158-5ec4-49e4-9049-b7f785e4bb7d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181257 Oct 04 08:58:11.178427 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 407/814] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 4 08:58:10 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:11.189030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:11.189555 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:11.203840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:11.209373 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:11.210736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:11.211658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:11.212315 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:11.212735 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:11.553220 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:11.567036 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:11.576340 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:11.577918 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1299471b-a180-49a4-9520-fbb0b3f21857 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.392975 Oct 04 08:58:11.618806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 408/815] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:11 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:12.551410 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-946636446", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38eace1c-70a5-4e3a-880c-50986fb2cf27"}], "security_groups": [{"name": "tempest-securitygroup--1358885175"}], "key_name": "tempest-keypair-1031719879", "user_data": "}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:12.614937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:12.616039 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:12.628682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:12.629438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:12.629890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:12.630745 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:12.631087 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:12.631514 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:12.826872 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.network.neutron [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] validate_networks() for [('38eace1c-70a5-4e3a-880c-50986fb2cf27', None, None, None, None, None)] {{(pid=127549) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:58:12.954832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:12.978064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:12.981463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:12.983775 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-15c9df08-2aeb-43d1-99db-be4ffd0b3313 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.374368 Oct 04 08:58:12.985256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 409/816] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:12 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:13.123787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-7f88a690-2566-4b92-bcfd-6680b56db512 req-1e830126-737c-467e-9681-f4f701fa7207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d632ced-345e-4586-9a9c-45f3fa279017", "tag": "40e61ddb-9135-44a4-af4c-083b3ed0acba"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:13.135298 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-7f88a690-2566-4b92-bcfd-6680b56db512 req-1e830126-737c-467e-9681-f4f701fa7207 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:13.136899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-7f88a690-2566-4b92-bcfd-6680b56db512 req-1e830126-737c-467e-9681-f4f701fa7207 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:13.137419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-7f88a690-2566-4b92-bcfd-6680b56db512 req-1e830126-737c-467e-9681-f4f701fa7207 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:13.152548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-7f88a690-2566-4b92-bcfd-6680b56db512 req-1e830126-737c-467e-9681-f4f701fa7207 service nova] Creating event network-changed:40e61ddb-9135-44a4-af4c-083b3ed0acba for instance 8d632ced-345e-4586-9a9c-45f3fa279017 on hv-cinder-85944 Oct 04 08:58:13.159430 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-7f88a690-2566-4b92-bcfd-6680b56db512 req-1e830126-737c-467e-9681-f4f701fa7207 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039390 Oct 04 08:58:13.163421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 410/817] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:58:13.454907 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Flavor limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:58:13.455543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Image limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:58:13.456713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Flavor pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:58:13.457224 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Image pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:58:13.458488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:58:13.467938 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:13.468760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:13.469410 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:13.470266 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:13.470844 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:13.471367 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:13.489796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for project 8760be982f804a9aa319b989aa1c3118. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:58:13.493956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Getting quotas for user 14d56042415540a3b3ed06578b712ca5 and project 8760be982f804a9aa319b989aa1c3118. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:58:13.496032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:13.507994 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Going to run 1 instances... {{(pid=127549) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:58:13.510551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:58:13.691632 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-da39b03b-2c20-403a-b8ea-31cd68c8c3b9 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.127796 Oct 04 08:58:13.700331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 408/818] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:58:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:58:13.713054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c4ce34c2-4db5-4669-a068-e3cf4b4ebf95 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:13.720651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c4ce34c2-4db5-4669-a068-e3cf4b4ebf95 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:13.847755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c4ce34c2-4db5-4669-a068-e3cf4b4ebf95 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:13.859249 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c4ce34c2-4db5-4669-a068-e3cf4b4ebf95 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1241 microversion: 2.1 time: 0.155265 Oct 04 08:58:13.860363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 411/819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:13 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:14.014963 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:14.016937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:14.036244 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:14.039706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:14.040400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:14.044210 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:14.046468 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:14.047400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:14.212501 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:14.222321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:14.224790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:14.225297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c3f10698-c62a-43ba-b7db-9056594945f7 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.216060 Oct 04 08:58:14.226167 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 409/820] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:14 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:14.249429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-43f2512e-1bb7-48b8-8fd9-92f09edae142 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Action: 'create', calling method: .version_select at 0x7f6f1a2be8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-746027221", "metadata": {"Type": "work"}}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:14.894252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:14.904265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:14.922699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:14.923203 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:14.923698 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:14.924465 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:14.926489 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:14.927306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:14.947425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-43f2512e-1bb7-48b8-8fd9-92f09edae142 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.855833 Oct 04 08:58:14.950033 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 412/821] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Oct 4 08:58:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 860 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 08:58:14.964271 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-632ad987-580f-4a92-883d-b31a889a3660 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Calling method '.version_select at 0x7f6f1a2a4c10>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:15.046034 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:15.056858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-81b64913-5c4a-4cb5-bc72-17c95156ed70 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1245 microversion: 2.1 time: 0.172549 Oct 04 08:58:15.069174 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 410/822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:14 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1245 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:15.069595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-632ad987-580f-4a92-883d-b31a889a3660 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3" status: 200 len: 352 microversion: 2.1 time: 0.108996 Oct 04 08:58:15.069595 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 413/823] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:58:14 2022] GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:15.252100 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:15.252768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:15.259590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:15.260322 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:15.261594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:15.262715 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:15.263324 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:15.263920 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:15.409695 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:15.440782 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:15.443492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:15.445057 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fa46a527-e5cf-4fc9-915b-411314f56b58 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.197367 Oct 04 08:58:15.445731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 411/824] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:15 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:15.933797 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1060579119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-868131196", "security_groups": [{"name": "tempest-secgroup-smoke-1824899816"}], "networks": [{"uuid": "241e3a87-6f8d-443d-978c-ba497455a028"}], "block_device_mapping_v2": [{"uuid": "97a9758f-0b14-4bd6-bec9-4a405bd60b98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:16.076855 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] validate_networks() for [('241e3a87-6f8d-443d-978c-ba497455a028', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:58:16.086959 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:16.087885 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:16.103524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:16.104224 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:16.105615 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:16.106636 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:16.107258 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:16.107850 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:16.188643 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:16.199841 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-10b733b2-85c6-444f-b929-9dfa32b6cc37 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1301 microversion: 2.1 time: 0.118497 Oct 04 08:58:16.204250 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 412/825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:16 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1301 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:16.211201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2076ec43-174d-41f4-ae6e-6f42d1ad1389 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Calling method '.version_select at 0x7f6f1a3d5790>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:16.298851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2076ec43-174d-41f4-ae6e-6f42d1ad1389 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3" status: 200 len: 353 microversion: 2.1 time: 0.092934 Oct 04 08:58:16.309204 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 413/826] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:58:16 2022] GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:16.314307 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ef81e822-fbf9-4e27-8d0d-0284169dc66f tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Calling method '.version_select at 0x7f6f1a352d30>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:16.421893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ef81e822-fbf9-4e27-8d0d-0284169dc66f tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3" status: 200 len: 353 microversion: 2.1 time: 0.111305 Oct 04 08:58:16.422599 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 414/827] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:58:16 2022] GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:16.438675 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-603f34ef-c0dc-48b2-844e-ade33b16a6fe tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Calling method '.version_select at 0x7f6f1a352670>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:16.658307 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:58:16.658757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:58:16.659227 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:58:16.659657 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:58:16.660062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:58:16.670372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:16.677294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-603f34ef-c0dc-48b2-844e-ade33b16a6fe tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3" status: 202 len: 0 microversion: 2.1 time: 0.238155 Oct 04 08:58:16.677294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 415/828] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:58:16 2022] DELETE /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:58:16.685422 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:16.686330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:16.687229 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:16.689043 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:16.689784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:16.692319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:16.692962 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:16.696747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:16.697229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:16.697665 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:16.707036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:16.707526 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:16.708143 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:16.732742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Getting quotas for project 655f83bbd3d847f3b060af2ff5250585. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:58:16.743863 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Getting quotas for user faa4a1f5f6954d92830b7df74952161e and project 655f83bbd3d847f3b060af2ff5250585. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:58:16.860390 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:58:16.862578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97a9758f-0b14-4bd6-bec9-4a405bd60b98',volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:58:16.928977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:16.940246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:16.941616 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:16.943037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ce2e196c-f377-4c60-ae7a-964778946627 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.263242 Oct 04 08:58:16.944075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 416/829] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:16 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:16.949223 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-22a71724-c301-459c-85f3-659497f1827c tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Calling method '.version_select at 0x7f6f1a3fc790>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:17.007827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-22a71724-c301-459c-85f3-659497f1827c tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3" status: 200 len: 352 microversion: 2.1 time: 0.062386 Oct 04 08:58:17.015546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 417/830] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:58:16 2022] GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:17.237943 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:17.240139 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:17.252609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:17.253473 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:17.256255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:17.257438 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:17.258107 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:17.259015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:17.458155 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-82411c32-721b-4843-acf1-46170bf2c107 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.528986 Oct 04 08:58:17.467374 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 414/831] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:58:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:58:17.473464 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1a52da67-6c8b-45b5-81d9-8d5a6618d558 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:17.474366 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1a52da67-6c8b-45b5-81d9-8d5a6618d558 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:17.537269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:17.548702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4ad96cbf-d744-4561-8ab3-1ece14425d9f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1367 microversion: 2.1 time: 0.319567 Oct 04 08:58:17.562931 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 418/832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:17 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:17.612747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1a52da67-6c8b-45b5-81d9-8d5a6618d558 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:17.622895 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1a52da67-6c8b-45b5-81d9-8d5a6618d558 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1088 microversion: 2.1 time: 0.153824 Oct 04 08:58:17.624064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 415/833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:17 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1088 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:17.970784 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:17.971305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:17.977278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:17.977757 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:17.978195 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:17.978893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:17.979348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:17.979767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:18.024623 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c023c567-f562-43a1-8c71-4dd48f8535b5 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Calling method '.version_select at 0x7f6f1a2feee0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:18.054986 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-c023c567-f562-43a1-8c71-4dd48f8535b5 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] HTTP exception thrown: Volume bf2a3d60-a01e-45b4-9f36-839de23b91d3 could not be found. Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c023c567-f562-43a1-8c71-4dd48f8535b5 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Request method failure captured: Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3 HTTP/1.1 Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_WlPI_sef9Rb_cOpXBj5uWorCATRenOX7CsSlDA6Pm4IOl-ZzMz4OGYporxhyd6QjNAGyNKsnviRWxjJVMnxrfGi9kYAfPWmDJDXfEYkfygeGmdVHOPl8dyrfn88I3-Geeltn3lQ18udtRE6kP2ICWlPKXybZlXDi_D8GDG3U0F4FQ Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 6d2655bf31d04940a66d895a03f1d853 Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesGetTestJSON-1905183225 Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:58:18.058053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6d2655bf31d04940a66d895a03f1d853"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d2655bf31d04940a66d895a03f1d853"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6d2655bf31d04940a66d895a03f1d853", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6d2655bf31d04940a66d895a03f1d853"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesGetTestJSON-1905183225 Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 6d2655bf31d04940a66d895a03f1d853 Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesGetTestJSON-1905183225 Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesGetTestJSON-1905183225-project Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: b0abd1294d0d4309be4b1f9734f9ce20 Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesGetTestJSON-1905183225-project Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Volume bf2a3d60-a01e-45b4-9f36-839de23b91d3 could not be found. Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'bf2a3d60-a01e-45b4-9f36-839de23b91d3'} Oct 04 08:58:18.064439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf2a3d60-a01e-45b4-9f36-839de23b91d3 could not be found. (HTTP 404) (Request-ID: req-6722a4b3-3b4b-40f1-b7a1-77edbaecc926) Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:58:18.066117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:58:18.067963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf2a3d60-a01e-45b4-9f36-839de23b91d3 could not be found. Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 08:58:18.070081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf2a3d60-a01e-45b4-9f36-839de23b91d3 could not be found. Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf2a3d60-a01e-45b4-9f36-839de23b91d3 could not be found. Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c023c567-f562-43a1-8c71-4dd48f8535b5 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] Returning 404 to user: Volume bf2a3d60-a01e-45b4-9f36-839de23b91d3 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c023c567-f562-43a1-8c71-4dd48f8535b5 tempest-VolumesGetTestJSON-1905183225 tempest-VolumesGetTestJSON-1905183225-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3" status: 404 len: 109 microversion: 2.1 time: 0.038818 Oct 04 08:58:18.071674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 416/834] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:58:18 2022] GET /compute/v2.1/os-volumes/bf2a3d60-a01e-45b4-9f36-839de23b91d3 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:58:18.128432 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:18.138265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:18.139745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:18.140932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-10b16016-e349-42d0-a2cd-b15fe93d6c92 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.174515 Oct 04 08:58:18.141801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 419/835] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:17 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:18.576062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:18.589205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:18.610593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:18.613788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:18.613788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:18.613788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:18.613788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:18.616876 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:18.647750 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b9dab9b3-f928-4015-aecf-ea422e77c67d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:18.648343 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b9dab9b3-f928-4015-aecf-ea422e77c67d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:18.788430 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b9dab9b3-f928-4015-aecf-ea422e77c67d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:18.800282 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b9dab9b3-f928-4015-aecf-ea422e77c67d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1088 microversion: 2.1 time: 0.156425 Oct 04 08:58:18.801900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 420/836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:18 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1088 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:18.824011 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-fe4744c5-11dc-471c-8e87-29cc1522f95f req-0ac11b95-2614-4e99-a62b-84d79ed7bd0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ea7b9b-0e42-4dba-990c-8db108fed6c2", "tag": "1bba9e38-ea39-4a9e-98bd-e086f0f6d07d"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:18.842824 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-fe4744c5-11dc-471c-8e87-29cc1522f95f req-0ac11b95-2614-4e99-a62b-84d79ed7bd0a service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:18.844344 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-fe4744c5-11dc-471c-8e87-29cc1522f95f req-0ac11b95-2614-4e99-a62b-84d79ed7bd0a service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:18.844779 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-fe4744c5-11dc-471c-8e87-29cc1522f95f req-0ac11b95-2614-4e99-a62b-84d79ed7bd0a service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:18.870048 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-fe4744c5-11dc-471c-8e87-29cc1522f95f req-0ac11b95-2614-4e99-a62b-84d79ed7bd0a service nova] Creating event network-changed:1bba9e38-ea39-4a9e-98bd-e086f0f6d07d for instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 on hv-cinder-85944 Oct 04 08:58:18.883198 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-fe4744c5-11dc-471c-8e87-29cc1522f95f req-0ac11b95-2614-4e99-a62b-84d79ed7bd0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079475 Oct 04 08:58:18.887577 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 421/837] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:18.910786 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:18.926562 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-81008e68-0eab-4e1b-9713-ee2147afd454 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1367 microversion: 2.1 time: 0.350176 Oct 04 08:58:18.926562 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 417/838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:18 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:19.168975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:19.169667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:19.184770 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:19.186900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:19.186900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:19.186900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:19.187164 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:19.187529 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:19.364678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:19.377203 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:19.379221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:19.380654 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2c26a81f-6882-450c-8f45-62c40e808220 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.216014 Oct 04 08:58:19.381279 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 422/839] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:19 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:19.824199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:19.824804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:19.831052 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:19.831532 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:19.831966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:19.832651 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:19.833103 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:19.833529 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:19.896032 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:19.903760 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f855fc32-2be9-486c-9755-35e2fb20b069 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1130 microversion: 2.1 time: 0.083578 Oct 04 08:58:19.904318 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 418/840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:19 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1130 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:19.951086 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:19.951710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:19.958127 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:19.958657 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:19.959099 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:19.959810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:19.960273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:19.960706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:20.106973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:20.114680 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-806560c3-2d16-4f15-8fe1-db446a9b6874 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1367 microversion: 2.1 time: 0.167973 Oct 04 08:58:20.115445 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 423/841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:19 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:20.407694 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:20.408304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:20.414261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:20.414770 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:20.415205 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:20.415884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:20.416333 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:20.416822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:20.553390 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:20.562381 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:20.563843 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:20.564983 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5fe1aca8-21f5-41d4-92f3-ebac9781ac21 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1736 microversion: 2.20 time: 0.161150 Oct 04 08:58:20.565531 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 419/842] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:20 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:20.927554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:20.928330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:20.934700 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:20.935193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:20.935628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:20.936329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:20.936785 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:20.937238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:20.941507 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:20.999280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:21.006747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c2d2a663-bbef-41d9-8a26-f0c6784ec574 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1186 microversion: 2.1 time: 0.083215 Oct 04 08:58:21.007309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 424/843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:20 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:21.139419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:21.140671 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:21.148038 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:21.149050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:21.149655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:21.150586 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:21.151800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:21.152488 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:21.306243 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:21.317418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8c2d96c8-283b-46e6-91a6-f1f4abb4e090 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1367 microversion: 2.1 time: 0.182474 Oct 04 08:58:21.318245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 420/844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:21 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:21.592268 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:21.593544 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:21.600007 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:21.600576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:21.601080 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:21.601867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:21.602389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:21.603096 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:21.750231 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:21.758444 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:21.760019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:21.762136 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7d05ebdc-b394-45ee-9bd5-d9d801dc6f46 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1718 microversion: 2.20 time: 0.175688 Oct 04 08:58:21.762918 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 425/845] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:21 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1718 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:22.029265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:22.029876 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:22.035958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:22.036450 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:22.036896 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:22.037600 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:22.038060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:22.038531 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:22.100596 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:22.109144 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f4b1e661-dfb6-464b-a73e-3d593c88b3ee tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1204 microversion: 2.1 time: 0.083726 Oct 04 08:58:22.109726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 421/846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:22 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:22.339826 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0c88826b-c520-4375-87db-5959c2741770 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a3d8790>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:22.351690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:22.352293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:22.359384 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:22.359875 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:22.360307 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:22.360995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:22.361449 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:22.361867 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:22.388911 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0c88826b-c520-4375-87db-5959c2741770 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b620c2f6-5bcd-47cf-81cb-5259f36c064f" status: 200 len: 350 microversion: 2.1 time: 0.053572 Oct 04 08:58:22.389625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 426/847] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:58:22 2022] GET /compute/v2.1/os-volumes/b620c2f6-5bcd-47cf-81cb-5259f36c064f => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:58:22.509036 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:22.517849 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9ebcc1c9-cb0b-47b2-bac7-0858969b9941 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1367 microversion: 2.1 time: 0.169781 Oct 04 08:58:22.518759 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 422/848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:22 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:22.788750 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:22.789502 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:22.797379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:22.800435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:22.800435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:22.800435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:22.800435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:22.800888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:23.133256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:23.133937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:23.140247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:23.140792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:23.142930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:23.142930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:23.142930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:23.142930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:23.146984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:23.193160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:23.201732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:23.203638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:23.205000 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a79ec4f9-fc3b-4624-a152-cd4e46733de9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1718 microversion: 2.20 time: 0.420260 Oct 04 08:58:23.205576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 427/849] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:22 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1718 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:23.292836 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:23.300618 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4c12e406-a418-4742-8d95-dfb8163e2ccb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1272 microversion: 2.1 time: 0.171428 Oct 04 08:58:23.301279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 423/850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:23 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:23.540277 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:23.540888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:23.543336 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:23.548062 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:23.548548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:23.549044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:23.549691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:23.550145 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:23.550603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:23.697462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:23.709380 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ff58156f-a770-4a72-a140-46db8ccc72e7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1367 microversion: 2.1 time: 0.172890 Oct 04 08:58:23.710641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 428/851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:23 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:24.003276 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d0f2a33d-2a81-457a-9aa2-9af67aab1f4e tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a2bed30>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:24.055185 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d0f2a33d-2a81-457a-9aa2-9af67aab1f4e tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/bb9eaf6d-999f-46b1-9aa2-ec3ce9b023a1" status: 200 len: 350 microversion: 2.1 time: 0.055642 Oct 04 08:58:24.055756 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 424/852] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:58:23 2022] GET /compute/v2.1/os-volumes/bb9eaf6d-999f-46b1-9aa2-ec3ce9b023a1 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:24.234202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:24.234861 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:24.240761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.241245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.241685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.242377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.242932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.243359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.323818 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:24.324425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:24.330386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.330905 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.331337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.332124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.332581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.333116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.416233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:24.426289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:24.428436 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:24.430841 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-334e3093-5c16-41da-9274-bee87a03fe34 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1721 microversion: 2.20 time: 0.201205 Oct 04 08:58:24.432180 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 429/853] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:24 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:24.447520 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-a64d44ac-cde7-4f52-b9f5-3fbe8cffb4bc req-2c90457d-af32-4a40-997a-57523e030909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da2fd17-4355-438b-a667-e7881a655fe2", "tag": "fea14249-82d5-4c27-9abc-925c8ffa80c5"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:24.458852 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-a64d44ac-cde7-4f52-b9f5-3fbe8cffb4bc req-2c90457d-af32-4a40-997a-57523e030909 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.459334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-a64d44ac-cde7-4f52-b9f5-3fbe8cffb4bc req-2c90457d-af32-4a40-997a-57523e030909 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.459760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-a64d44ac-cde7-4f52-b9f5-3fbe8cffb4bc req-2c90457d-af32-4a40-997a-57523e030909 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.473402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-a64d44ac-cde7-4f52-b9f5-3fbe8cffb4bc req-2c90457d-af32-4a40-997a-57523e030909 service nova] Creating event network-changed:fea14249-82d5-4c27-9abc-925c8ffa80c5 for instance 0da2fd17-4355-438b-a667-e7881a655fe2 on hv-cinder-85944 Oct 04 08:58:24.478260 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-a64d44ac-cde7-4f52-b9f5-3fbe8cffb4bc req-2c90457d-af32-4a40-997a-57523e030909 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044705 Oct 04 08:58:24.479084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 430/854] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:24.484767 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3c9a3a7-7864-4da8-b116-09ee34dad54e"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:24.487326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:24.493448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.493942 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.494375 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.495442 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.496062 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.496654 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.534810 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:24.542961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-20d92a9d-a9b9-4963-a8a7-26f88d28db14 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.223126 Oct 04 08:58:24.559762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 425/855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:24 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:24.734417 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:24.739860 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:24.741169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.741670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.742328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.743090 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.743719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.744149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.890992 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:24.900455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-25cc718c-5ecb-4a00-bcf9-48e31c1173e0 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1367 microversion: 2.1 time: 0.170141 Oct 04 08:58:24.901254 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 426/856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:24 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:24.923293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-6aae9246-74db-4839-bbfd-02c8bffc78b4 req-3791c499-bdef-4e48-ac8c-3ab76900f673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ea7b9b-0e42-4dba-990c-8db108fed6c2", "name": "network-vif-plugged", "status": "completed", "tag": "1bba9e38-ea39-4a9e-98bd-e086f0f6d07d"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:24.933447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-6aae9246-74db-4839-bbfd-02c8bffc78b4 req-3791c499-bdef-4e48-ac8c-3ab76900f673 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:24.934132 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-6aae9246-74db-4839-bbfd-02c8bffc78b4 req-3791c499-bdef-4e48-ac8c-3ab76900f673 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:24.934636 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-6aae9246-74db-4839-bbfd-02c8bffc78b4 req-3791c499-bdef-4e48-ac8c-3ab76900f673 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:24.946052 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-6aae9246-74db-4839-bbfd-02c8bffc78b4 req-3791c499-bdef-4e48-ac8c-3ab76900f673 service nova] Creating event network-vif-plugged:1bba9e38-ea39-4a9e-98bd-e086f0f6d07d for instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 on hv-cinder-85944 Oct 04 08:58:24.952136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-6aae9246-74db-4839-bbfd-02c8bffc78b4 req-3791c499-bdef-4e48-ac8c-3ab76900f673 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034720 Oct 04 08:58:24.952746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 427/857] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:25.571500 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:25.572193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:25.582853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:25.582853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:25.582853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:25.582853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:25.583346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:25.583346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:25.596788 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b11da13d-9750-4fcf-9aea-dc6bfad67cb8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.116032 Oct 04 08:58:25.597468 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 431/858] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Oct 4 08:58:24 2022] POST /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/os-volume_attachments => generated 188 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 08:58:25.674219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e760d467-43d0-4f8f-a2a4-84875c2bf7c4 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a370ca0>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:25.726957 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e760d467-43d0-4f8f-a2a4-84875c2bf7c4 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/7e721d71-c038-4cd7-b1ed-124a18088478" status: 200 len: 350 microversion: 2.1 time: 0.056396 Oct 04 08:58:25.727524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 432/859] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:58:25 2022] GET /compute/v2.1/os-volumes/7e721d71-c038-4cd7-b1ed-124a18088478 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:58:25.741843 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bea113c7-efcf-4d72-aecd-9a1ac748fa57 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a3d5a60>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:25.742018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:25.750590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-864fb1eb-c22a-45a7-a276-5d740b4cad7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.183135 Oct 04 08:58:25.751179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 428/860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:25 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:25.830491 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bea113c7-efcf-4d72-aecd-9a1ac748fa57 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.093314 Oct 04 08:58:25.831143 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 433/861] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 4 08:58:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:25.847719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3801f1fd-0ce2-45d4-ab5a-55012fe9acff tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a290c10>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:25.891301 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:25.891793 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:25.897872 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:25.900378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:25.900378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:25.900378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:25.900378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:25.900833 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:25.931310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3801f1fd-0ce2-45d4-ab5a-55012fe9acff tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087219 Oct 04 08:58:25.934827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 429/862] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Oct 4 08:58:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:25.936674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:25.937420 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:25.943712 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:25.944204 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:25.944641 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:25.945343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:25.945797 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:25.946225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:26.081713 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:26.090115 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4c3f181c-f65f-4ca0-a1ad-eae8c83e4a0e tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1367 microversion: 2.1 time: 0.156944 Oct 04 08:58:26.090778 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 430/863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:25 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:26.095136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a7a61b25-c718-43ad-bd9d-99fc49e6d557 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a2be550>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:26.178380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a7a61b25-c718-43ad-bd9d-99fc49e6d557 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086556 Oct 04 08:58:26.179016 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 431/864] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Oct 4 08:58:26 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:26.193288 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-82a38932-7871-426b-aa9e-e1b1937a16c2 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a290280>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:26.282936 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-82a38932-7871-426b-aa9e-e1b1937a16c2 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093163 Oct 04 08:58:26.283435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 432/865] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Oct 4 08:58:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:58:26.296630 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e65f3caf-e930-478a-845d-d922de7e4734 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a290af0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:26.380490 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e65f3caf-e930-478a-845d-d922de7e4734 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087449 Oct 04 08:58:26.381060 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 433/866] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Oct 4 08:58:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:58:26.395655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c0f72daf-0ef8-4ebc-812b-7535668d6689 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a2be8b0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:26.476620 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c0f72daf-0ef8-4ebc-812b-7535668d6689 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084677 Oct 04 08:58:26.477217 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 434/867] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 4 08:58:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:26.487582 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ab5acaa0-d3e9-4043-b61b-9a0c5f835002 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/os-volume_attachments/b3c9a3a7-7864-4da8-b116-09ee34dad54e" status: 202 len: 0 microversion: 2.20 time: 0.601918 Oct 04 08:58:26.488255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 434/868] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Oct 4 08:58:25 2022] DELETE /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/os-volume_attachments/b3c9a3a7-7864-4da8-b116-09ee34dad54e => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:58:26.490834 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-264668c9-9987-4f73-b41a-88cd0a3801cb tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1ddbeb80>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:26.559887 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:26.560486 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:26.566551 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:26.567104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:26.567548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:26.568402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:26.568857 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:26.569285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:26.586309 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-264668c9-9987-4f73-b41a-88cd0a3801cb tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098949 Oct 04 08:58:26.586974 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 435/869] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Oct 4 08:58:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:58:26.600848 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0ce673cb-213e-45a2-b6d5-1a6b470e8179 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] Calling method '.version_select at 0x7f6f1a2be430>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:26.601893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127549) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 08:58:26.693716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0ce673cb-213e-45a2-b6d5-1a6b470e8179 tempest-VolumesTestJSON-417795137 tempest-VolumesTestJSON-417795137-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.097086 Oct 04 08:58:26.694564 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 436/870] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Oct 4 08:58:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:26.771779 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:26.775716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:26.778587 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:26.784816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:26.785305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:26.785744 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:26.786510 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:26.786921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:26.787352 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:26.828800 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-18e2d261-6b28-4b5f-b625-59e1e572d0f6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "POST /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/action" status: 202 len: 0 microversion: 2.20 time: 0.273571 Oct 04 08:58:26.829736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 435/871] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Oct 4 08:58:26 2022] POST /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:58:26.838388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:26.839549 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:26.846664 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:26.847163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:26.847799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:26.853354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:26.853354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:26.853354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:27.068711 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:27.080729 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:27.083038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:27.084361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8023a911-f840-4a1f-897a-fa20174e5e74 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1669 microversion: 2.20 time: 0.250282 Oct 04 08:58:27.085144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 436/872] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:26 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1669 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:27.098668 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-e554af8d-22c7-49a3-9464-13189398991d req-c78f6a3d-6784-4c91-a6fc-b09c018d9a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feee8000-fafa-45b3-be22-370bb07f0c88", "name": "network-vif-unplugged", "status": "completed", "tag": "7224ed3c-c9cb-445e-bb2f-be715b606313"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:27.105591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e554af8d-22c7-49a3-9464-13189398991d req-c78f6a3d-6784-4c91-a6fc-b09c018d9a65 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:27.106628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e554af8d-22c7-49a3-9464-13189398991d req-c78f6a3d-6784-4c91-a6fc-b09c018d9a65 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:27.107291 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-e554af8d-22c7-49a3-9464-13189398991d req-c78f6a3d-6784-4c91-a6fc-b09c018d9a65 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:27.121530 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.compute.server_external_events [req-e554af8d-22c7-49a3-9464-13189398991d req-c78f6a3d-6784-4c91-a6fc-b09c018d9a65 service nova] Unable to find a host for instance feee8000-fafa-45b3-be22-370bb07f0c88. Dropping event network-vif-unplugged {{(pid=127549) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 08:58:27.121749 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:27.123401 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-e554af8d-22c7-49a3-9464-13189398991d req-c78f6a3d-6784-4c91-a6fc-b09c018d9a65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036400 Oct 04 08:58:27.124090 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 437/873] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 08:58:27.129096 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:27.129645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:27.129804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d0be0f6f-6fc3-44ed-9c5d-1037c9e4a424 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.358734 Oct 04 08:58:27.130310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 437/874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:26 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:27.136847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:27.139932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:27.139932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:27.139932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:27.139932 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:27.140345 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:27.279915 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:27.287843 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-53eb1dff-3504-4e03-a0af-65a7e5f56a5a tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1557 microversion: 2.1 time: 0.162739 Oct 04 08:58:27.288402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 438/875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:27 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:27.311130 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:27.311557 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:27.317738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:27.321847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:27.321847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:27.321847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:27.321847 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:27.322210 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:27.398729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-815c2af0-b65a-4064-a479-976f58ef26ae tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091571 Oct 04 08:58:27.399566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 438/876] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Oct 4 08:58:27 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:28.117312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:28.117881 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:28.129496 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:28.129496 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:28.129496 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:28.129496 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:28.130217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:28.130217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:28.131462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:28.153045 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=10 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:28.156635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:28.157253 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:28.177499 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:28.177898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:28.178337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:28.179082 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:28.179538 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:28.179972 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:28.349865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:28.359476 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:28.361334 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:28.362789 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-64f7d936-f835-44fd-af0d-bd94fccb9487 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1669 microversion: 2.20 time: 0.249597 Oct 04 08:58:28.363830 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 439/877] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:28 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1669 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:28.390136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:28.401591 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-69a739e1-c6b7-402b-9449-c5d9eb99cea2 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.251973 Oct 04 08:58:28.402354 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 439/878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:28 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:28.457509 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-52afae1f-9354-426a-9e7c-e5edecc737cd req-efce7166-9409-43a0-997d-896d3964555c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ea7b9b-0e42-4dba-990c-8db108fed6c2", "tag": "1bba9e38-ea39-4a9e-98bd-e086f0f6d07d"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:28.469405 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-52afae1f-9354-426a-9e7c-e5edecc737cd req-efce7166-9409-43a0-997d-896d3964555c service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:28.469882 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-52afae1f-9354-426a-9e7c-e5edecc737cd req-efce7166-9409-43a0-997d-896d3964555c service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:28.470856 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-52afae1f-9354-426a-9e7c-e5edecc737cd req-efce7166-9409-43a0-997d-896d3964555c service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:28.482828 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-52afae1f-9354-426a-9e7c-e5edecc737cd req-efce7166-9409-43a0-997d-896d3964555c service nova] Creating event network-changed:1bba9e38-ea39-4a9e-98bd-e086f0f6d07d for instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 on hv-cinder-85944 Oct 04 08:58:28.488702 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-52afae1f-9354-426a-9e7c-e5edecc737cd req-efce7166-9409-43a0-997d-896d3964555c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034737 Oct 04 08:58:28.490931 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 440/879] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:29.393761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:29.394362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:29.402544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:29.403113 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:29.403761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:29.404551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:29.405236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:29.405735 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:29.427537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=12 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:29.437246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:29.438241 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:29.467197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:29.468278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:29.469177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:29.471625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:29.473308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:29.474628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:29.675355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:29.691104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:29.693257 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:29.699484 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bf2aa94c-25ee-467e-be07-4584146c4671 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.312007 Oct 04 08:58:29.702166 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 440/880] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:29 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:29.734678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:29.743474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4904d9e2-8580-4ae1-9df7-81849ca119ba tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.317885 Oct 04 08:58:29.758956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 441/881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:29 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:30.731740 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:30.732922 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:30.744533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:30.745074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:30.745890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:30.747525 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:30.748064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:30.748637 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:30.769974 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:30.771925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:30.784075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:30.784984 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:30.785760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:30.787992 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:30.788944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:30.789703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:31.076487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:31.103992 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:31.105755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:31.107009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5da2f16e-5cb3-4984-b1ef-9b8da222c454 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.380859 Oct 04 08:58:31.111624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 441/882] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:30 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:31.112768 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:31.118679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-bf129765-5d8a-41cb-b3d0-d73de6dc6d79 req-e69b94a8-4c63-4ba1-b8a9-7d73334a9cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da2fd17-4355-438b-a667-e7881a655fe2", "name": "network-vif-plugged", "status": "completed", "tag": "fea14249-82d5-4c27-9abc-925c8ffa80c5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:31.132493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bf129765-5d8a-41cb-b3d0-d73de6dc6d79 req-e69b94a8-4c63-4ba1-b8a9-7d73334a9cbe service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:31.133590 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bf129765-5d8a-41cb-b3d0-d73de6dc6d79 req-e69b94a8-4c63-4ba1-b8a9-7d73334a9cbe service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:31.135096 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bf129765-5d8a-41cb-b3d0-d73de6dc6d79 req-e69b94a8-4c63-4ba1-b8a9-7d73334a9cbe service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:31.135208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1d85fcd8-686c-4ce7-b8d4-258fa3a14348 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.370276 Oct 04 08:58:31.136258 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 442/883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:30 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:31.166677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-bf129765-5d8a-41cb-b3d0-d73de6dc6d79 req-e69b94a8-4c63-4ba1-b8a9-7d73334a9cbe service nova] Creating event network-vif-plugged:fea14249-82d5-4c27-9abc-925c8ffa80c5 for instance 0da2fd17-4355-438b-a667-e7881a655fe2 on hv-cinder-85944 Oct 04 08:58:31.172439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-bf129765-5d8a-41cb-b3d0-d73de6dc6d79 req-e69b94a8-4c63-4ba1-b8a9-7d73334a9cbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063421 Oct 04 08:58:31.176490 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 442/884] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:32.134831 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:32.135715 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:32.142213 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:32.142740 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:32.143180 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:32.143869 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:32.144325 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:32.144751 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:32.159881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:32.160656 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:32.167498 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:32.168474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:32.169351 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:32.170259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:32.170923 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:32.171548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:32.377241 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:32.387596 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:32.390278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:32.392038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a98c6b8d-0270-42a5-9b74-39f2bc0e9722 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.261081 Oct 04 08:58:32.393118 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 443/885] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:32 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:32.418292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:32.426110 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3917fdd7-f5e7-4c0d-b129-3347726008b4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.270815 Oct 04 08:58:32.427458 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 443/886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:32 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:33.419050 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:33.419679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:33.427712 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:33.428504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:33.429165 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:33.430088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:33.430754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:33.431346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:33.451710 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:33.452267 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:33.461375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:33.461871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:33.462314 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:33.463115 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:33.463619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:33.464421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:33.622947 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:33.642877 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:33.647738 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:33.650714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-86976c40-d87b-47ff-b337-1492ea9694cc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.236836 Oct 04 08:58:33.653810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 444/887] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:33 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:33.718390 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:33.731931 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e9efcf2e-431a-4ee6-819d-98a8a6b1e372 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.284907 Oct 04 08:58:33.733881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 444/888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:33 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:34.680571 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:34.681375 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:34.688443 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.689115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.689556 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.690260 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.690803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.691263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.759706 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:34.760753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:34.768097 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.768676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.769190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.769971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:34.770769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:34.771277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:34.860159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:34.868436 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:34.870572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:34.871709 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-41fb34fe-a125-4bf2-b8d8-46b4cff696c1 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.195079 Oct 04 08:58:34.872254 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 445/889] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:34 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:34.943136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:34.951170 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c797ea80-e4d5-4dbb-a0df-3b21b62bbe27 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.196102 Oct 04 08:58:34.951750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 445/890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:34 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:35.897161 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:35.897771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:35.904249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:35.904732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:35.905166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:35.905853 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:35.906309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:35.906755 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:35.974886 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:35.975427 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:35.977810 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:35.982776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:35.983324 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:35.983758 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:35.984437 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:35.984886 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:35.985306 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:36.071950 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:36.081004 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:36.082458 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:36.083614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b1949d50-be76-4ec3-ba1a-4fb14d3c413a tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.190413 Oct 04 08:58:36.084171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 446/891] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:35 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:36.148892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:36.157186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-17fe010d-e5ab-4f4b-89b0-657c898519da tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.186186 Oct 04 08:58:36.169613 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 446/892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:35 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:37.111860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:37.112814 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:37.119391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:37.120136 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:37.120798 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:37.121532 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:37.122000 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:37.122452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:37.182435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:37.183191 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:37.189737 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:37.190259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:37.190726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:37.191421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:37.191893 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:37.192305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:37.335857 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:37.345803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:37.347413 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:37.348842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-19c170ec-5d89-48bd-a2d5-05000e3aadbc tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.241024 Oct 04 08:58:37.350472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 447/893] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:37 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:37.388883 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:37.396676 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-46b97177-9282-4954-8e15-006ac1633d6d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.218058 Oct 04 08:58:37.397271 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 447/894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:37 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:38.375811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:38.377041 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:38.384429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:38.386101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:38.386940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:38.387781 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:38.388540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:38.390975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:38.419412 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:38.420026 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:38.426721 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:38.427211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:38.427648 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:38.428338 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:38.428794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:38.429221 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:38.637003 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:38.645365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:38.646712 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:38.646858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:38.648046 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1053bc20-536a-43de-b5d3-e32cbeff6d52 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.276581 Oct 04 08:58:38.648847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 448/895] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:38 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:38.654786 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d34dcf8d-a359-4771-a363-2c47ede8bb5b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.239243 Oct 04 08:58:38.655353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 448/896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:38 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:39.681160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:39.682499 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:39.683392 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:39.683996 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:39.690909 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:39.691118 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:39.691396 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:39.691535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:39.691937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:39.692052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:39.692636 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:39.692742 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:39.693085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:39.693287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:39.693507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:39.693847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:39.717895 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=100 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:39.929758 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:39.931980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:39.941984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:39.943466 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:39.944964 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a405bb95-7f81-436b-8102-3a33bde35de4 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.265564 Oct 04 08:58:39.945840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 449/897] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:39 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:39.947597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5d737a49-0295-4b73-baaa-c9c3eb7ce9a6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.273326 Oct 04 08:58:39.949453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 449/898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:39 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:40.979731 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:40.980370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:40.985969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:40.990262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:40.990388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:40.990388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:40.990388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:40.990388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:40.990734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:40.990734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:40.993569 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:40.994068 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:40.994575 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:40.995889 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:40.996683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:40.997365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:41.185946 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:41.197583 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:41.209260 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:41.211240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:41.211544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f3dff18e-df0c-4c43-a8a2-2a791ed71fc7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.236098 Oct 04 08:58:41.212233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 450/899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:40 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:41.231293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e2a887e9-18cf-4073-a912-ad58cef4be93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.248896 Oct 04 08:58:41.232019 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 450/900] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:40 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:42.237175 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:42.238045 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:42.258917 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:42.259711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:42.260153 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:42.261575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:42.262319 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:42.262773 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:42.263420 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:42.264040 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:42.280807 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:42.284462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:42.284968 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:42.286970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:42.287589 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:42.289895 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:42.476275 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:42.480712 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:42.484400 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b6502803-71e6-417f-a717-bcf86fa241c4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.252077 Oct 04 08:58:42.484970 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 451/901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:42 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:42.488778 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:42.490224 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:42.491409 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9aabc08f-4a51-415f-95d7-ecd164e961d6 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.233973 Oct 04 08:58:42.491955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 451/902] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:42 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:43.507787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:43.508421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:43.515346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:43.515830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:43.516260 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:43.516944 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:43.517395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:43.517521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:43.517928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:43.518073 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:43.524723 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:43.525206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:43.525653 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:43.526335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:43.527401 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:43.527836 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:43.717430 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:43.720840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:43.725274 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-86e2bb03-fff3-4432-8e4d-1a7686a51a28 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.221341 Oct 04 08:58:43.725934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 452/903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:43 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:43.728892 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:43.730447 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:43.731607 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4fe4fb26-1596-48d9-8cef-b9c5cdf635df tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.218078 Oct 04 08:58:43.732355 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 452/904] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:43 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:44.749209 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:44.749828 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:44.756356 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:44.756912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:44.757315 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:44.757729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:44.757934 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:44.758053 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:44.758519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:44.758957 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:44.764832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:44.765317 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:44.765757 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:44.766612 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:44.767097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:44.767530 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:44.972709 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:44.975803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:44.980753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-09fac242-38e6-44c5-8ce3-087cbda5f863 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.236568 Oct 04 08:58:44.981333 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 453/905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:44 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:44.985285 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:44.991329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:44.991329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a025ad68-c13e-4376-92ca-7082416f83ea tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.236232 Oct 04 08:58:44.991329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 453/906] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:44 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:46.004911 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:46.005541 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:46.012765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:46.014331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:46.014331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:46.014571 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:46.015321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:46.015755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:46.015920 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:46.016527 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:46.019294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:46.024097 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:46.024580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:46.025012 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:46.025708 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:46.026158 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:46.026620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:46.238237 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:46.246328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-de195fa1-49d7-4c46-9a4d-c6245064a155 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1260 microversion: 2.1 time: 0.245926 Oct 04 08:58:46.246958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 454/907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:45 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:46.269257 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:46.279977 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:46.292481 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:46.292481 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4b1410a5-b337-4e12-aa36-5bd6301e81e9 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.271758 Oct 04 08:58:46.292481 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 454/908] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:46 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:47.280619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:47.281973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:47.288221 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.288711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.289149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.289843 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.290658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.290794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.310154 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:47.311484 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:47.318690 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.319462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.320595 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.321376 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.321962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.322511 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.480276 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:47.488597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2a3ea6fa-eed5-4da9-96fc-9d54dbab7abd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1444 microversion: 2.1 time: 0.214185 Oct 04 08:58:47.489167 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 455/909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:47 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1444 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:58:47.504237 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:47.512428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:47.513029 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:47.513372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:47.515631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:47.516812 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-4cb32b35-5a83-465a-abaf-eeade9442235 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.211438 Oct 04 08:58:47.517370 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 455/910] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:47 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:58:47.519169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.519648 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.520140 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.520770 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:47.521219 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:47.521640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:47.651419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:47.659323 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-eccf8bae-b7d5-41b2-a096-fe9e3cfff506 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1444 microversion: 2.1 time: 0.150916 Oct 04 08:58:47.659887 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 456/911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:58:47 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:58:48.543588 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:48.544309 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:48.550707 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:48.551273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:48.551790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:48.552555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:48.553014 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:48.553444 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:48.569480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:48.691127 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:48.699435 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:48.700886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:48.703004 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-62eec7bc-765d-4b31-9044-ebfc21c92c00 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.163522 Oct 04 08:58:48.703775 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 456/912] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:48 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:49.648846 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-8f78ef9d-2d40-4431-8f1e-e3fd69928c7e req-352a092c-804a-421a-b8c9-1f9a7290cd9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da2fd17-4355-438b-a667-e7881a655fe2", "tag": "fea14249-82d5-4c27-9abc-925c8ffa80c5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:49.659333 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8f78ef9d-2d40-4431-8f1e-e3fd69928c7e req-352a092c-804a-421a-b8c9-1f9a7290cd9b service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.659820 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8f78ef9d-2d40-4431-8f1e-e3fd69928c7e req-352a092c-804a-421a-b8c9-1f9a7290cd9b service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.660261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-8f78ef9d-2d40-4431-8f1e-e3fd69928c7e req-352a092c-804a-421a-b8c9-1f9a7290cd9b service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.672608 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-8f78ef9d-2d40-4431-8f1e-e3fd69928c7e req-352a092c-804a-421a-b8c9-1f9a7290cd9b service nova] Creating event network-changed:fea14249-82d5-4c27-9abc-925c8ffa80c5 for instance 0da2fd17-4355-438b-a667-e7881a655fe2 on hv-cinder-85944 Oct 04 08:58:49.677731 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-8f78ef9d-2d40-4431-8f1e-e3fd69928c7e req-352a092c-804a-421a-b8c9-1f9a7290cd9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032804 Oct 04 08:58:49.678385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 457/913] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:49.729661 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:49.730339 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:49.738628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.739437 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.740256 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.741220 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:49.741886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:49.742550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:49.882061 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:49.891306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:49.892762 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:49.893970 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0a5babf5-1067-44aa-9ca2-078910752623 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.168176 Oct 04 08:58:49.910679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 457/914] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:49 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:50.715448 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-243d9279-69f5-403e-b2ad-6af64c653e99 req-a6fcf69c-9ab7-4c03-8428-deba988e4a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feee8000-fafa-45b3-be22-370bb07f0c88", "name": "network-vif-plugged", "status": "completed", "tag": "7224ed3c-c9cb-445e-bb2f-be715b606313"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:50.724216 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-243d9279-69f5-403e-b2ad-6af64c653e99 req-a6fcf69c-9ab7-4c03-8428-deba988e4a69 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.724699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-243d9279-69f5-403e-b2ad-6af64c653e99 req-a6fcf69c-9ab7-4c03-8428-deba988e4a69 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.725129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-243d9279-69f5-403e-b2ad-6af64c653e99 req-a6fcf69c-9ab7-4c03-8428-deba988e4a69 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:50.735804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-243d9279-69f5-403e-b2ad-6af64c653e99 req-a6fcf69c-9ab7-4c03-8428-deba988e4a69 service nova] Creating event network-vif-plugged:7224ed3c-c9cb-445e-bb2f-be715b606313 for instance feee8000-fafa-45b3-be22-370bb07f0c88 on hv-cinder-85944 Oct 04 08:58:50.740578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-243d9279-69f5-403e-b2ad-6af64c653e99 req-a6fcf69c-9ab7-4c03-8428-deba988e4a69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031396 Oct 04 08:58:50.741326 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 458/915] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:50.920795 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:50.921408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:50.927867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.928354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.928792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:50.929482 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:50.929935 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:50.930363 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:51.062470 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:51.070753 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:51.072191 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:51.073337 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-40951341-bc28-4a56-8d0d-be8bc245e5ff tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.156674 Oct 04 08:58:51.073888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 458/916] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:50 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:52.100190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:52.100916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:52.107078 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:52.107684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:52.108125 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:52.108840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:52.109297 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:52.109762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:52.246209 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:52.254955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:52.256556 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:52.257753 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1d51f0cc-c6a2-40d1-bc63-1185765facde tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.162311 Oct 04 08:58:52.258382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 459/917] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:52 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:53.283776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:53.284392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:53.291206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.291695 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.292131 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.292833 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:53.293292 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:53.293722 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:53.428675 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:53.437559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:53.439028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:53.440172 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5fd46be9-8eb6-449a-a1f8-a84956e9622f tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1727 microversion: 2.20 time: 0.160638 Oct 04 08:58:53.440727 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 459/918] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:53 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:54.465936 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:54.467193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:54.473478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:54.473957 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:54.474393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:54.475100 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:54.475551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:54.475974 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:54.609807 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:54.617966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:54.619506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:58:54.620603 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-beb89383-4a21-45fb-8557-631c29e10c9e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1714 microversion: 2.20 time: 0.158551 Oct 04 08:58:54.621157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 460/919] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:58:54 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:58:57.109032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:58:57.109514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:57.115335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:57.115811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:57.116243 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:57.116922 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:57.117371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:57.117790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:57.141663 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1e3dcf1a-f449-46e3-8e70-6f13dce19f42 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/ips" status: 200 len: 144 microversion: 2.1 time: 0.192353 Oct 04 08:58:57.142210 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 460/920] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:58:56 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/ips => generated 144 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:58:58.676612 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "014bb0cd-5868-4e10-ac66-0b65b76ab5e3"}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:58:58.679062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:58:58.685907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.686394 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.686868 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:58.687561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:58:58.688017 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:58:58.688465 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:58:59.362196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a5429337-9897-45ee-8017-f3a5a8456957 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689105 Oct 04 08:58:59.362743 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 461/921] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:58:58 2022] POST /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:10.089166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:10.091596 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:10.095474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=13 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:10.100674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=25 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:10.100822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:10.101315 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:10.101761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:10.102493 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:10.102960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:10.103386 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:10.133498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-69bfe253-94d6-4de1-87b1-b1064e0c762f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048317 Oct 04 08:59:10.134230 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 461/922] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:59:10 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:10.144022 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=31 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:10.144912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:10.149282 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:10.149931 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:10.155922 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:10.156418 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:10.157487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:10.158265 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:10.158751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:10.159184 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:10.189594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-46ce6665-8d4e-4d1f-a987-d5a9f9d186bf tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/014bb0cd-5868-4e10-ac66-0b65b76ab5e3" status: 200 len: 194 microversion: 2.1 time: 0.047190 Oct 04 08:59:10.190180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 462/923] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 4 08:59:10 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/014bb0cd-5868-4e10-ac66-0b65b76ab5e3 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:11.840279 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "142472ef-4aa4-4c4d-bf50-caee3eba7227"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:11.842647 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:11.850368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.850875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.851316 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:11.852055 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:11.852514 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:11.852946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:12.514961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e0029084-3398-4ee9-ae37-8635e6e93a14 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "POST /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.678388 Oct 04 08:59:12.515563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 462/924] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:59:11 2022] POST /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments => generated 194 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:15.633107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:15.640925 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:15.641948 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.642789 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.642789 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.643323 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:15.643783 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:15.644212 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:15.668467 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4e50bd89-b8c4-49c0-96f2-7429cdc1ddca tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.039009 Oct 04 08:59:15.669106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 463/925] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:59:15 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:17.261391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1383a326-e639-47d0-a8d6-63f541cdf10e"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:17.265945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:17.275104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:17.275104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:17.275104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.275348 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:17.275698 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:17.276122 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:17.920612 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7b27a4d0-4bb6-41ef-941e-7163c8aebf76 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "POST /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663728 Oct 04 08:59:17.924860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 463/926] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Oct 4 08:59:17 2022] POST /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:20.162996 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:20.165486 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:20.172556 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.173042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.173475 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.174858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.175236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.175654 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.207011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7fdad140-b8ec-4d23-93fd-55a0450a209a tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048891 Oct 04 08:59:20.207574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 464/927] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:59:20 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:20.351130 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:20.351766 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:20.357921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.358417 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.358870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.359561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.360150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.360580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.394621 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-852ff30a-0cc4-4288-852f-28e8676a21dd tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/014bb0cd-5868-4e10-ac66-0b65b76ab5e3" status: 200 len: 194 microversion: 2.1 time: 0.049390 Oct 04 08:59:20.395441 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 464/928] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 4 08:59:20 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/014bb0cd-5868-4e10-ac66-0b65b76ab5e3 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:20.405770 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:20.406267 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:20.413189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.413619 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.414061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.414792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:20.415434 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:20.415875 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:20.501788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lazy-loading 'services' on Instance uuid 8d632ced-345e-4586-9a9c-45f3fa279017 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:20.733456 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-add6b464-8a16-4776-b675-56ca8da64d63 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/014bb0cd-5868-4e10-ac66-0b65b76ab5e3" status: 202 len: 0 microversion: 2.1 time: 0.331431 Oct 04 08:59:20.735408 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 465/929] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:59:20 2022] DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/014bb0cd-5868-4e10-ac66-0b65b76ab5e3 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:27.701955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:27.702517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:27.709452 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:27.709937 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:27.710372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:27.711262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:27.711716 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:27.712135 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:27.832484 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'services' on Instance uuid a9ea7b9b-0e42-4dba-990c-8db108fed6c2 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:28.100489 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-88d21f6e-2a67-4aa8-ad6b-3b8d6e7caad4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments/1383a326-e639-47d0-a8d6-63f541cdf10e" status: 202 len: 0 microversion: 2.1 time: 0.402101 Oct 04 08:59:28.101163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 465/930] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:59:27 2022] DELETE /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments/1383a326-e639-47d0-a8d6-63f541cdf10e => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:28.115356 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:28.118214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:28.124431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:28.124917 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:28.127507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:28.127507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:28.127507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:28.127507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:28.158236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5664fa9c-6f4b-4c28-9196-8426ae6ba336 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051365 Oct 04 08:59:28.158910 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 466/931] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:59:28 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:28.238982 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:28.239894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:28.248007 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:28.248537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:28.248982 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:28.249714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:28.250166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:28.250771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:28.282878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-716a1ae0-3967-46d3-a9b9-9b29788b0428 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/142472ef-4aa4-4c4d-bf50-caee3eba7227" status: 200 len: 194 microversion: 2.1 time: 0.048996 Oct 04 08:59:28.283462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 466/932] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Oct 4 08:59:28 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/142472ef-4aa4-4c4d-bf50-caee3eba7227 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:28.294571 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:28.295094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:28.302001 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:28.302543 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:28.303018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:28.303711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:28.304170 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:28.304599 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:28.388011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lazy-loading 'services' on Instance uuid 8d632ced-345e-4586-9a9c-45f3fa279017 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:28.585102 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0fb2b184-bdf6-4728-83db-cfff292b12e1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/142472ef-4aa4-4c4d-bf50-caee3eba7227" status: 202 len: 0 microversion: 2.1 time: 0.294341 Oct 04 08:59:28.585878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 467/933] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Oct 4 08:59:28 2022] DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments/142472ef-4aa4-4c4d-bf50-caee3eba7227 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:29.171715 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:29.174028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:29.181077 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:29.181563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:29.182002 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:29.182714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:29.183163 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:29.183708 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:29.216270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-916580d5-3664-482b-8bf4-f37b03d79cd7 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048440 Oct 04 08:59:29.216911 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 467/934] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:59:29 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:29.739726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-755739786", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "networks": [{"uuid": "b6baeb7f-3d3d-4aed-b922-058db1f05b2c"}]}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:29.794566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] validate_networks() for [('b6baeb7f-3d3d-4aed-b922-058db1f05b2c', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:59:30.154367 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:59:30.154947 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:59:30.155612 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:59:30.156121 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:59:30.156719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:59:30.165565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.165985 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.166446 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.167179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.167631 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.168056 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.185119 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Getting quotas for project f9e5915b40b84a859f5ab0fb5892c973. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:59:30.189073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Getting quotas for user 6027a9e1cfe74099a92eb3b39ce6361b and project f9e5915b40b84a859f5ab0fb5892c973. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:59:30.200461 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:59:30.202878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:59:30.228863 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:30.231034 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:30.237263 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.237744 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.238178 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.239451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.240122 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.240471 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.270565 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8ee94478-6305-4810-a2ef-51e965aa5e3f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045519 Oct 04 08:59:30.271138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 468/935] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:59:30 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:59:30.296983 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-88f1b13b-d1cf-4145-8fc2-1730ed3daab1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562152 Oct 04 08:59:30.297940 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 468/936] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:59:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:59:30.309976 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0dd4c134-5840-4ee4-aae0-57d70f810fe3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:30.310624 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0dd4c134-5840-4ee4-aae0-57d70f810fe3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:30.335912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:30.336409 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:30.342868 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.343430 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.343872 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.344569 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.345028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.345817 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.372272 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0dd4c134-5840-4ee4-aae0-57d70f810fe3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:30.375929 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:59:30.378851 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0dd4c134-5840-4ee4-aae0-57d70f810fe3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1213 microversion: 2.1 time: 0.072516 Oct 04 08:59:30.379695 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 469/937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:30 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:30.615727 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ea975ce0-09de-4f02-84b5-0918c1b4495f tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 204 len: 0 microversion: 2.1 time: 0.283119 Oct 04 08:59:30.616442 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 469/938] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:30 2022] DELETE /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 08:59:30.624797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:30.625411 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:30.631726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.632249 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.632687 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.633373 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.633829 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.634288 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.767712 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:30.776944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d37cafe3-f9d5-4362-9821-9e5f3fe8f3e3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1682 microversion: 2.1 time: 0.156114 Oct 04 08:59:30.777721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 470/939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:30 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:30.857124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:30.859592 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:30.866345 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.866874 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.867314 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.868008 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:30.868464 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:30.868899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:30.899128 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ff3176aa-07e9-448e-9416-f1e94ca616a1 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046375 Oct 04 08:59:30.899685 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 470/940] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:59:30 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:59:31.023317 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:31.025590 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:31.031920 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.032404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.032838 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.033525 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.033974 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.034396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.063328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bfe346f9-c497-46ab-a540-c83a14f8635f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044719 Oct 04 08:59:31.063874 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 471/941] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Oct 4 08:59:31 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 08:59:31.128099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:31.128598 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:31.135401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.135892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.136332 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.137028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.137485 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.138197 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.164331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:59:31.402837 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:31.403451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:31.409892 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.410370 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.410866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.411616 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.412069 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.412493 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.419549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-369ddf00-0648-452f-8b93-8caa4a295586 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 204 len: 0 microversion: 2.1 time: 0.294957 Oct 04 08:59:31.420393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 471/942] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:31 2022] DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:59:31.429022 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:31.429716 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:31.435650 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.436131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.436564 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.437248 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.437699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.438120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.480287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:31.487987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-81074b5c-8b38-4f88-9274-6d8ce44a4ba4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1217 microversion: 2.1 time: 0.089007 Oct 04 08:59:31.488550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 472/943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:31 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:31.573954 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:31.581646 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a243c7b8-97c4-4060-b265-7d148b9a55a9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1670 microversion: 2.1 time: 0.156852 Oct 04 08:59:31.582138 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 472/944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:31 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:31.803408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:31.804015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:31.809868 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.810345 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.810810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.811489 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:31.811940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:31.812359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:31.941346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:31.949659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0e2b8eab-7294-4363-8a7d-b6d29c8fc27c tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1682 microversion: 2.1 time: 0.150613 Oct 04 08:59:31.950219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 473/945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:31 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:32.512077 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:32.512610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:32.519266 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:32.519746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:32.520178 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:32.520850 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:32.521681 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:32.522097 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:32.583654 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:32.591211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-326f3fa3-8adf-436d-a2a2-9a5a3182ed93 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1217 microversion: 2.1 time: 0.083121 Oct 04 08:59:32.591769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 473/946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:32 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:32.605568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:32.606302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:32.612783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:32.613262 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:32.613687 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:32.614372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:32.615546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:32.615975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:32.742916 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:32.750697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d29c10fe-3a69-471a-899b-53ed1acb4b9f tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1670 microversion: 2.1 time: 0.148941 Oct 04 08:59:32.751265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 474/947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:32 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:32.973678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:32.975030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:32.980936 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:32.981414 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:32.981843 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:32.982544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:32.982996 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:32.983414 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:33.112683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:33.112683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:33.117603 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1af46fa8-b415-42a5-ae40-05997b5be282 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1682 microversion: 2.1 time: 0.147970 Oct 04 08:59:33.118166 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 474/948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:32 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:33.615067 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:33.616456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:33.622186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:33.622730 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:33.623169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:33.623876 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:33.624330 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:33.624754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:33.628998 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:33.692579 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:33.701543 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5251c4c3-8280-43c4-b895-bcc48b6bd6b4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1217 microversion: 2.1 time: 0.090358 Oct 04 08:59:33.702106 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 475/949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:33 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:33.775433 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:33.776573 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:33.783919 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:33.784410 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:33.784843 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:33.785544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:33.786002 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:33.786445 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:33.925506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:33.934609 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-26f52fa0-859a-442b-aa3d-39b7f91fce83 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1670 microversion: 2.1 time: 0.163964 Oct 04 08:59:33.935177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 475/950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:33 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:34.142865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:34.143557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:34.150133 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.150655 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.151096 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.151791 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.152243 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.152921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.195791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:34.198072 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:34.221049 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.221940 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.225122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.225122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.225122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.225122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.268892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-eb04c229-b156-44a6-815a-8f5c73bae215 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.076978 Oct 04 08:59:34.269755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 476/951] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Oct 4 08:59:34 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:34.326512 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:34.334619 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e368c615-2815-4839-961c-eab42c7effe3 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1682 microversion: 2.1 time: 0.197201 Oct 04 08:59:34.335440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 476/952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:34 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:34.340843 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:34.341351 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:34.348385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.348881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.349857 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.351425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.352055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.352493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.379682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:59:34.660535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3a21df4a-ef57-425d-af20-99a7a4151365 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 204 len: 0 microversion: 2.20 time: 0.323185 Oct 04 08:59:34.661471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 477/953] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 4 08:59:34 2022] DELETE /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:59:34.670278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:34.671515 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:34.678260 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.678871 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.679376 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.683669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.683669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.683669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.726714 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:34.727427 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:34.733491 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.733978 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.734435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.735211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.735705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.736138 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.849162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:34.857181 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-23af1a67-c342-425b-b2e5-c4a1e06683e3 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1265 microversion: 2.1 time: 0.135688 Oct 04 08:59:34.860277 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:34.868610 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:34.870042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:34.871233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9185c429-5019-4224-b983-a264ee11ac72 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.204854 Oct 04 08:59:34.871795 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 477/954] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:34 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:59:34.882244 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 478/955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:34 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:34.960287 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:34.960929 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:34.966960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.967453 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.967890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:34.968588 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:34.969045 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:34.969472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:35.031404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:35.039301 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-68f6b15d-9921-4abb-ad65-3ee238e6c722 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1603 microversion: 2.1 time: 0.083698 Oct 04 08:59:35.039876 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 478/956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:34 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1603 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:35.281690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-b0f35b9a-6afd-42ad-9502-492f507e4898 req-98c9b4d6-472c-46b4-943a-45eec46076b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ea7b9b-0e42-4dba-990c-8db108fed6c2", "name": "network-vif-deleted", "tag": "1bba9e38-ea39-4a9e-98bd-e086f0f6d07d"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:35.297796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b0f35b9a-6afd-42ad-9502-492f507e4898 req-98c9b4d6-472c-46b4-943a-45eec46076b5 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.298375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b0f35b9a-6afd-42ad-9502-492f507e4898 req-98c9b4d6-472c-46b4-943a-45eec46076b5 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.298900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b0f35b9a-6afd-42ad-9502-492f507e4898 req-98c9b4d6-472c-46b4-943a-45eec46076b5 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:35.312670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-b0f35b9a-6afd-42ad-9502-492f507e4898 req-98c9b4d6-472c-46b4-943a-45eec46076b5 service nova] Creating event network-vif-deleted:1bba9e38-ea39-4a9e-98bd-e086f0f6d07d for instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 on hv-cinder-85944 Oct 04 08:59:35.320791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-b0f35b9a-6afd-42ad-9502-492f507e4898 req-98c9b4d6-472c-46b4-943a-45eec46076b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046221 Oct 04 08:59:35.321773 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 479/957] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:35.359393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:35.360012 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:35.382145 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.382679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.383125 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:35.383873 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.384332 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.384757 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:35.468539 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:35.476529 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-26377746-722d-460a-aa26-9dcbce6e1dd6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1614 microversion: 2.1 time: 0.121012 Oct 04 08:59:35.477104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 479/958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:35 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:35.900587 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:35.901408 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:35.901890 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:35.902900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:35.911118 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.912117 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.915533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.921969 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.922101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:35.922188 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:35.922265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.922342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:35.922464 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.922464 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:35.922607 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:35.923116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:36.075279 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:36.101499 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cbc99329-e377-48a3-b07a-f623c2916f4f tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1273 microversion: 2.1 time: 0.205045 Oct 04 08:59:36.115070 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 480/959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:35 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:36.120622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:36.121738 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:36.129021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:36.129983 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:36.130686 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:36.131952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:36.132566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:36.133174 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:36.210909 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:36.211645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:36.212306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:36.212919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lazy-loading 'fault' on Instance uuid 8d632ced-345e-4586-9a9c-45f3fa279017 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:36.232277 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:36.244098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:36.245544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:36.258698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-65921a0c-b214-4689-9001-a9fc3d8b6f41 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.360402 Oct 04 08:59:36.258698 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 480/960] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:35 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:36.275212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:36.284440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-99c1149a-d4f6-4ba2-a791-7d1c0a425a31 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1326 microversion: 2.1 time: 0.167858 Oct 04 08:59:36.285289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 481/961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:36 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1326 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:36.503678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:36.504296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:36.516587 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:36.517390 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:36.518144 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:36.519372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:36.519989 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:36.520572 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:36.568189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:36.568678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:36.569114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:36.569575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lazy-loading 'fault' on Instance uuid a9ea7b9b-0e42-4dba-990c-8db108fed6c2 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:36.909294 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d56042415540a3b3ed06578b712ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8760be982f804a9aa319b989aa1c3118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:36.919840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-da2cb42a-9883-4d58-9eed-9d49be07f6e6 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 200 len: 1331 microversion: 2.1 time: 0.420990 Oct 04 08:59:36.920911 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 481/962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:36 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 1331 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:36.984033 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-3a09be22-0a10-40bd-9f2e-3a5f1d0d2ff8 req-d9724bd1-c470-4de0-91a3-355c9e825f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feee8000-fafa-45b3-be22-370bb07f0c88", "name": "network-vif-unplugged", "status": "completed", "tag": "7224ed3c-c9cb-445e-bb2f-be715b606313"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:36.999542 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-3a09be22-0a10-40bd-9f2e-3a5f1d0d2ff8 req-d9724bd1-c470-4de0-91a3-355c9e825f05 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:36.999850 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-3a09be22-0a10-40bd-9f2e-3a5f1d0d2ff8 req-d9724bd1-c470-4de0-91a3-355c9e825f05 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.000366 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-3a09be22-0a10-40bd-9f2e-3a5f1d0d2ff8 req-d9724bd1-c470-4de0-91a3-355c9e825f05 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.014731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-3a09be22-0a10-40bd-9f2e-3a5f1d0d2ff8 req-d9724bd1-c470-4de0-91a3-355c9e825f05 service nova] Creating event network-vif-unplugged:7224ed3c-c9cb-445e-bb2f-be715b606313 for instance feee8000-fafa-45b3-be22-370bb07f0c88 on hv-cinder-85944 Oct 04 08:59:37.019804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-3a09be22-0a10-40bd-9f2e-3a5f1d0d2ff8 req-d9724bd1-c470-4de0-91a3-355c9e825f05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041053 Oct 04 08:59:37.023825 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 482/963] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:37.131755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:37.131755 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:37.136500 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.137293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.138088 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.138827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.139292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.139883 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.203419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:37.212165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bd8cae33-1b9e-4023-8d60-d8b4d2cfd3df tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1271 microversion: 2.1 time: 0.087446 Oct 04 08:59:37.218915 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 482/964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:37 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:37.290084 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:37.290954 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:37.297229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.297847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.298295 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.300799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.300799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.300799 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.311677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:37.312504 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:37.318955 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.319439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.319875 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.320649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.321106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.321926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.355033 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.355519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.355958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.356407 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lazy-loading 'fault' on Instance uuid 8d632ced-345e-4586-9a9c-45f3fa279017 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:37.410162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb93504f2605489eaf50cf10930b3e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc8433b42fb74e8bbfef92acedf01259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:37.419331 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a23f15c1-6bd6-4a7a-90a4-daf5835347e8 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 200 len: 1326 microversion: 2.1 time: 0.111551 Oct 04 08:59:37.419912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 483/965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:37 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:37.424841 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-57fdceca-43bf-4a97-817a-c145a61ae75f req-39bfc30c-6ee6-411e-a53e-43c15e28418f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d632ced-345e-4586-9a9c-45f3fa279017", "name": "network-vif-deleted", "tag": "40e61ddb-9135-44a4-af4c-083b3ed0acba"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:37.438190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-57fdceca-43bf-4a97-817a-c145a61ae75f req-39bfc30c-6ee6-411e-a53e-43c15e28418f service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.438705 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-57fdceca-43bf-4a97-817a-c145a61ae75f req-39bfc30c-6ee6-411e-a53e-43c15e28418f service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.439393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-57fdceca-43bf-4a97-817a-c145a61ae75f req-39bfc30c-6ee6-411e-a53e-43c15e28418f service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.452167 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-57fdceca-43bf-4a97-817a-c145a61ae75f req-39bfc30c-6ee6-411e-a53e-43c15e28418f service nova] Creating event network-vif-deleted:40e61ddb-9135-44a4-af4c-083b3ed0acba for instance 8d632ced-345e-4586-9a9c-45f3fa279017 on hv-cinder-85944 Oct 04 08:59:37.456801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-57fdceca-43bf-4a97-817a-c145a61ae75f req-39bfc30c-6ee6-411e-a53e-43c15e28418f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035436 Oct 04 08:59:37.457345 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 484/966] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:37.468809 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:37.478306 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:37.480087 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:37.480921 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b10d9c43-a555-4ea0-8840-c96bbcf6ed93 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1720 microversion: 2.20 time: 0.195394 Oct 04 08:59:37.481469 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 483/967] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:37 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 08:59:37.951556 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:37.952487 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:37.960441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.960941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.961380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.962091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:37.962712 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:37.963466 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:37.978597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 HTTP/1.1 Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:37.980439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:37.982074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'a9ea7b9b-0e42-4dba-990c-8db108fed6c2'} Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:37.983031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:37.984558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:37.985831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:37.985831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-be0cb998-acd8-4681-aa8d-6c5e224a5d25 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 404 len: 111 microversion: 2.1 time: 0.035170 Oct 04 08:59:37.985991 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 485/968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:37 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:37.992052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1f406619-3e3d-403e-bdb5-854e889e1d20 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '.version_select at 0x7f6f1a540e50>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:38.107699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1f406619-3e3d-403e-bdb5-854e889e1d20 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031719879" status: 202 len: 0 microversion: 2.1 time: 0.119902 Oct 04 08:59:38.108638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 484/969] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 4 08:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031719879 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:38.236194 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:38.237243 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:38.244117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.245138 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.245879 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.247017 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.247898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.248803 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.423688 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:38.431977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-47181c5e-c6b6-4b79-82a9-a5e0e805ca76 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1313 microversion: 2.1 time: 0.200026 Oct 04 08:59:38.446803 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 486/970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:38 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:38.447294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:38.448171 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:38.455636 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.467490 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.468715 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.469396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.469889 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.470562 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.507860 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:38.508475 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:38.518239 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] HTTP exception thrown: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Request method failure captured: Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 HTTP/1.1 Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_SQzlLLavllRtBcvrWBzjOJWRRb54TycfEAh0sjfKqdy-lija3kmdvJRwB8ULeh6hPG4-zZsUMGAWHMVmunKTLXzY5-5oEVbX3WglKvdcntub-vqMELbCa7afezD9FsnfbYylu4xO9-0044r26ZGS5cIN5fdxkhng6SeuecOKdHbXc Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:38.520559 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc8433b42fb74e8bbfef92acedf01259", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: cb93504f2605489eaf50cf10930b3e46 Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:38.527331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '8d632ced-345e-4586-9a9c-45f3fa279017'} Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:38.528792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:38.529958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:38.531075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Returning 404 to user: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:38.531151 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.531151 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.531151 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.531379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5d25a129-0f4f-455e-84b7-4c6b4640cec9 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 404 len: 111 microversion: 2.1 time: 0.083551 Oct 04 08:59:38.531379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 485/971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:38 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:38.532213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.532213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.532213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.533205 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9600cfa6-aea5-404b-9675-952e1d044d25 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '.version_select at 0x7f6f1a43baf0>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:38.586360 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:38.586908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:38.587401 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:38.587867 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lazy-loading 'fault' on Instance uuid feee8000-fafa-45b3-be22-370bb07f0c88 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:38.652972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9600cfa6-aea5-404b-9675-952e1d044d25 tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200323699" status: 202 len: 0 microversion: 2.1 time: 0.123422 Oct 04 08:59:38.656954 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 486/972] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Oct 4 08:59:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200323699 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:38.681939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:38.692553 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:38.695085 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '835a297b6e75416ea9bd1a82b466b2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3deef8b1cc4c9193e9357f0ba99e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:38.696385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-1e7d60a0-88c4-466f-9801-46abd2f36f90 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 200 len: 1369 microversion: 2.20 time: 0.192764 Oct 04 08:59:38.697028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 487/973] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:38 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 08:59:39.456341 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:39.457987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:39.468463 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:39.469508 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:39.470153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:39.471132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:39.471752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:39.472341 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:39.492051 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-58a0c890-d9f9-4977-821f-019c3ba57470 req-c56266b6-8240-40de-863d-f8a00c5a285e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feee8000-fafa-45b3-be22-370bb07f0c88", "name": "network-vif-deleted", "tag": "7224ed3c-c9cb-445e-bb2f-be715b606313"}, {"name": "network-changed", "server_uuid": "9899c0dc-ffc8-4077-ae74-626c92ef357b", "tag": "910bb228-653c-42c4-9692-f08bf4a007b7"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:39.508134 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-58a0c890-d9f9-4977-821f-019c3ba57470 req-c56266b6-8240-40de-863d-f8a00c5a285e service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:39.508880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-58a0c890-d9f9-4977-821f-019c3ba57470 req-c56266b6-8240-40de-863d-f8a00c5a285e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:39.514711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-58a0c890-d9f9-4977-821f-019c3ba57470 req-c56266b6-8240-40de-863d-f8a00c5a285e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:39.524474 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-58a0c890-d9f9-4977-821f-019c3ba57470 req-c56266b6-8240-40de-863d-f8a00c5a285e service nova] Creating event network-vif-deleted:7224ed3c-c9cb-445e-bb2f-be715b606313 for instance feee8000-fafa-45b3-be22-370bb07f0c88 on hv-cinder-85944 Oct 04 08:59:39.525257 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-58a0c890-d9f9-4977-821f-019c3ba57470 req-c56266b6-8240-40de-863d-f8a00c5a285e service nova] Creating event network-changed:910bb228-653c-42c4-9692-f08bf4a007b7 for instance 9899c0dc-ffc8-4077-ae74-626c92ef357b on hv-cinder-85944 Oct 04 08:59:39.531827 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-58a0c890-d9f9-4977-821f-019c3ba57470 req-c56266b6-8240-40de-863d-f8a00c5a285e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046849 Oct 04 08:59:39.533014 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 488/974] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:39.675297 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:39.683633 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6a262727-bdf2-4000-83a1-e29c7298cded tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1313 microversion: 2.1 time: 0.232292 Oct 04 08:59:39.684200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 487/975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:39 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:39.725836 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:39.726574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:39.736459 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:39.736990 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:39.737430 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:39.738141 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:39.739348 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:39.739348 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:39.756825 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] HTTP exception thrown: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Request method failure captured: Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 HTTP/1.1 Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q1bS2Rso7HwHIxnKtH06ZGqYmE2XZ8q9NmwluJcrTAkxL9mDrTZPycDNqrTri82W3hJkvNuiQAdY4tPHd_Mk6ZO2cr9qDLYK8Q5LDJwv5e47Sl90R9a0H85ekwPytsOT90u9gOVpZ7XDPkKWGIKXPKIQOgEi1tUGMwayVNRmoHGp8 Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:39.760364 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f3deef8b1cc4c9193e9357f0ba99e15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 835a297b6e75416ea9bd1a82b466b2a9 Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:39.761780 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'feee8000-fafa-45b3-be22-370bb07f0c88'} Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:39.762708 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:39.764346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:39.765585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Returning 404 to user: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:39.765585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ea13a570-a864-4b04-8806-8c945c6c0e5e tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 404 len: 111 microversion: 2.20 time: 0.037920 Oct 04 08:59:39.765585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 489/976] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:39 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:59:39.771346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1fe5b120-ded6-4681-9bfb-05d91dd8d119 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '.version_select at 0x7f6f1a43b5e0>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:39.895473 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1fe5b120-ded6-4681-9bfb-05d91dd8d119 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770376321" status: 204 len: 0 microversion: 2.20 time: 0.127976 Oct 04 08:59:39.896159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 488/977] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Oct 4 08:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1770376321 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 08:59:40.647077 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:40.647975 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:40.650071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:40.650912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=6 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:40.656161 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.656655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.657098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.657832 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.658292 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.658747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.673966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 HTTP/1.1 Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:40.675575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.676959 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'a9ea7b9b-0e42-4dba-990c-8db108fed6c2'} Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:40.678189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.679802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.681131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:40.681131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-05f1832c-98e1-4785-9b69-10f1b0ca09af tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 404 len: 111 microversion: 2.1 time: 0.034693 Oct 04 08:59:40.681131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 490/978] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:40 2022] DELETE /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:40.684355 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:40.689023 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:40.691979 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: a9ea7b9b-0e42-4dba-990c-8db108fed6c2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:40.696303 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.696795 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.697245 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.697959 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.698457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.699046 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.706622 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:40.707240 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:40.714633 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 HTTP/1.1 Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:40.716206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.717535 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'a9ea7b9b-0e42-4dba-990c-8db108fed6c2'} Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:40.718259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. Oct 04 08:59:40.721434 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:40.722735 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.722848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance a9ea7b9b-0e42-4dba-990c-8db108fed6c2 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:40.722939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.722939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.723114 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-daea39ca-1137-42fd-8ed6-262f461806b1 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2" status: 404 len: 111 microversion: 2.1 time: 0.034663 Oct 04 08:59:40.723216 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:40.723216 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:40.723391 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 489/979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:40 2022] GET /compute/v2.1/servers/a9ea7b9b-0e42-4dba-990c-8db108fed6c2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:40.723480 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:40.895746 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:40.904880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e56fe80e-aaf9-4bf0-b136-285e5f5c4007 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1313 microversion: 2.1 time: 0.202685 Oct 04 08:59:40.919266 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 491/980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:40 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:41.930479 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:41.931066 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:41.933480 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:41.938235 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:41.938862 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:41.939305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:41.939993 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:41.940446 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:41.940866 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.011917 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.016528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.016528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:42.019907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.020293 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.020741 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.022077 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.022583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.023067 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.037809 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e HTTP/1.1 Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:42.039321 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.040861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '01deb208-ffd0-4664-90dc-aca0a3fff70e'} Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:42.041747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.043261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.046135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:42.046135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9a2e87d2-f7c5-408a-b1f3-0c5d01837bfe tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 404 len: 111 microversion: 2.1 time: 0.032897 Oct 04 08:59:42.046135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 492/981] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:42 2022] DELETE /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:42.049353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.049963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 01deb208-ffd0-4664-90dc-aca0a3fff70e] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.056370 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.056861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.057320 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.061383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.061383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.061383 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.073312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e HTTP/1.1 Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:42.075040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.076891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '01deb208-ffd0-4664-90dc-aca0a3fff70e'} Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:42.077682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. Oct 04 08:59:42.078942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.080121 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance 01deb208-ffd0-4664-90dc-aca0a3fff70e could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:42.080121 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0c0369d4-334b-4af8-975c-e40066ceeb56 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e" status: 404 len: 111 microversion: 2.1 time: 0.031037 Oct 04 08:59:42.080121 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 493/982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:42 2022] GET /compute/v2.1/servers/01deb208-ffd0-4664-90dc-aca0a3fff70e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:59:42.086852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.087737 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.093321 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:42.095680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.096168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.096672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.097298 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.097750 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.098166 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.103116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:42.105409 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c61450f3-9f95-4783-b784-a50be1f06f6b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1313 microversion: 2.1 time: 0.179525 Oct 04 08:59:42.106282 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 490/983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:41 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:42.112685 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 HTTP/1.1 Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:42.114375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.136971 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'e6871eef-a47d-4c71-b1c8-4dc6aee127e5'} Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:42.137831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.139533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.140928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:42.140928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4a3029a0-6c88-4308-9aa2-907fcff88267 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 404 len: 111 microversion: 2.1 time: 0.035122 Oct 04 08:59:42.140928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 494/984] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:42 2022] DELETE /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:42.141161 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.141161 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: e6871eef-a47d-4c71-b1c8-4dc6aee127e5] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.141161 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.141161 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.141485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.141485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.141485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.141485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.153416 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 HTTP/1.1 Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:42.154952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.156485 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'e6871eef-a47d-4c71-b1c8-4dc6aee127e5'} Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:42.157270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. Oct 04 08:59:42.158697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.159917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance e6871eef-a47d-4c71-b1c8-4dc6aee127e5 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:42.159917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-edca86cb-582f-4a33-be4c-f9303d0f93c4 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5" status: 404 len: 111 microversion: 2.1 time: 0.029936 Oct 04 08:59:42.159917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 491/985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:42 2022] GET /compute/v2.1/servers/e6871eef-a47d-4c71-b1c8-4dc6aee127e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:42.249509 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.250093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.258366 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.258887 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.259325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.259996 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.260473 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.260892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.274796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] HTTP exception thrown: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Request method failure captured: Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 HTTP/1.1 Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q1bS2Rso7HwHIxnKtH06ZGqYmE2XZ8q9NmwluJcrTAkxL9mDrTZPycDNqrTri82W3hJkvNuiQAdY4tPHd_Mk6ZO2cr9qDLYK8Q5LDJwv5e47Sl90R9a0H85ekwPytsOT90u9gOVpZ7XDPkKWGIKXPKIQOgEi1tUGMwayVNRmoHGp8 Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:42.276353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f3deef8b1cc4c9193e9357f0ba99e15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 835a297b6e75416ea9bd1a82b466b2a9 Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.277913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'feee8000-fafa-45b3-be22-370bb07f0c88'} Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:42.278858 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.280316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.281794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Returning 404 to user: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:42.281794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-64d735cf-8a49-4dbc-9bb9-99a9229cfc59 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 404 len: 111 microversion: 2.20 time: 0.032664 Oct 04 08:59:42.281794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 495/986] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 4 08:59:42 2022] DELETE /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:59:42.286218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.286860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: feee8000-fafa-45b3-be22-370bb07f0c88] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.292945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.293361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.293791 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.294550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.295006 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.295427 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.309586 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] HTTP exception thrown: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Request method failure captured: Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 HTTP/1.1 Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q1bS2Rso7HwHIxnKtH06ZGqYmE2XZ8q9NmwluJcrTAkxL9mDrTZPycDNqrTri82W3hJkvNuiQAdY4tPHd_Mk6ZO2cr9qDLYK8Q5LDJwv5e47Sl90R9a0H85ekwPytsOT90u9gOVpZ7XDPkKWGIKXPKIQOgEi1tUGMwayVNRmoHGp8 Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:42.311116 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f3deef8b1cc4c9193e9357f0ba99e15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 835a297b6e75416ea9bd1a82b466b2a9 Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.312674 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'feee8000-fafa-45b3-be22-370bb07f0c88'} Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:42.313578 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. Oct 04 08:59:42.315144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.316518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Returning 404 to user: Instance feee8000-fafa-45b3-be22-370bb07f0c88 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:42.316518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-dffee709-5bd1-4414-93fb-bc005a8992ee tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88" status: 404 len: 111 microversion: 2.20 time: 0.030053 Oct 04 08:59:42.316518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 492/987] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:42 2022] GET /compute/v2.1/servers/feee8000-fafa-45b3-be22-370bb07f0c88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:59:42.377011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.378738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.384183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.384669 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.385144 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.385831 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.386282 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.386729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.401478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] HTTP exception thrown: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Request method failure captured: Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 HTTP/1.1 Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_SQzlLLavllRtBcvrWBzjOJWRRb54TycfEAh0sjfKqdy-lija3kmdvJRwB8ULeh6hPG4-zZsUMGAWHMVmunKTLXzY5-5oEVbX3WglKvdcntub-vqMELbCa7afezD9FsnfbYylu4xO9-0044r26ZGS5cIN5fdxkhng6SeuecOKdHbXc Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:42.403061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc8433b42fb74e8bbfef92acedf01259", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: cb93504f2605489eaf50cf10930b3e46 Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.404639 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '8d632ced-345e-4586-9a9c-45f3fa279017'} Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:42.405528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.412578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.414261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Returning 404 to user: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:42.414261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9eb3ddef-3cbb-4b64-b477-3acc8d2b2b2d tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 404 len: 111 microversion: 2.1 time: 0.032124 Oct 04 08:59:42.414261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 496/988] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:42 2022] DELETE /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:42.419460 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:42.420201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: 8d632ced-345e-4586-9a9c-45f3fa279017] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:42.426688 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.427834 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.428464 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.429020 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:42.429474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:42.429903 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:42.443915 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] HTTP exception thrown: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Request method failure captured: Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 HTTP/1.1 Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_SQzlLLavllRtBcvrWBzjOJWRRb54TycfEAh0sjfKqdy-lija3kmdvJRwB8ULeh6hPG4-zZsUMGAWHMVmunKTLXzY5-5oEVbX3WglKvdcntub-vqMELbCa7afezD9FsnfbYylu4xO9-0044r26ZGS5cIN5fdxkhng6SeuecOKdHbXc Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:42.445466 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc8433b42fb74e8bbfef92acedf01259", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: cb93504f2605489eaf50cf10930b3e46 Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.447293 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '8d632ced-345e-4586-9a9c-45f3fa279017'} Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:42.448153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. Oct 04 08:59:42.449846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:42.451308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Returning 404 to user: Instance 8d632ced-345e-4586-9a9c-45f3fa279017 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:42.451308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-194da714-f31a-4634-825d-5e48d58143ee tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017" status: 404 len: 111 microversion: 2.1 time: 0.031413 Oct 04 08:59:42.451308 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 493/989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:42 2022] GET /compute/v2.1/servers/8d632ced-345e-4586-9a9c-45f3fa279017 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:43.066018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-c42ce1f7-6dec-4b10-a20e-42995a17717e req-20d66189-97ae-470d-9523-6788859f360b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9899c0dc-ffc8-4077-ae74-626c92ef357b", "name": "network-vif-plugged", "status": "completed", "tag": "910bb228-653c-42c4-9692-f08bf4a007b7"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:43.076741 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-c42ce1f7-6dec-4b10-a20e-42995a17717e req-20d66189-97ae-470d-9523-6788859f360b service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.077218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-c42ce1f7-6dec-4b10-a20e-42995a17717e req-20d66189-97ae-470d-9523-6788859f360b service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.077668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-c42ce1f7-6dec-4b10-a20e-42995a17717e req-20d66189-97ae-470d-9523-6788859f360b service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.089762 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-c42ce1f7-6dec-4b10-a20e-42995a17717e req-20d66189-97ae-470d-9523-6788859f360b service nova] Creating event network-vif-plugged:910bb228-653c-42c4-9692-f08bf4a007b7 for instance 9899c0dc-ffc8-4077-ae74-626c92ef357b on hv-cinder-85944 Oct 04 08:59:43.094560 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-c42ce1f7-6dec-4b10-a20e-42995a17717e req-20d66189-97ae-470d-9523-6788859f360b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032565 Oct 04 08:59:43.095131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 497/990] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:43.133101 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:43.133707 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:43.140597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.141079 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.141513 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.142197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.142747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.143628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.284527 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:43.292593 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b8103650-8014-4b22-97f6-c3e7966ffbdc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1313 microversion: 2.1 time: 0.164208 Oct 04 08:59:43.293152 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 494/991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:43 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:43.459687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:43.460315 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:43.467047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.467938 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.468598 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.469502 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.469963 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.470636 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.484968 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 HTTP/1.1 Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:43.486719 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.488273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '1a71a25f-8f53-4c71-8f61-9687de80f727'} Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:43.489073 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.493136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.494547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:43.494547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-22e0a8e3-e63a-432b-8165-078d837ff338 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 404 len: 111 microversion: 2.1 time: 0.033341 Oct 04 08:59:43.494547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 498/992] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:43 2022] DELETE /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:43.497088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:43.497754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] [instance: 1a71a25f-8f53-4c71-8f61-9687de80f727] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:43.503874 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.504353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.504815 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.506146 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.506632 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.507063 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.521783 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] HTTP exception thrown: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Request method failure captured: Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 HTTP/1.1 Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q9qdbZ49R59xgjSsVJypoWsMn6JMGmboebKfMdJKycUe9MHlY-XpV9hZAfnC2zBie6cbWBxTWpo6sUj4SaNr280J4Sy4kVuVf7s2OE5GQpjLf8l0vfTry1Im6ZurFMbjCFD0GBbbEpWExr2YmN7Il5DobBNdJj7aYTXPZq9ii8_yY Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:43.523335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8760be982f804a9aa319b989aa1c3118", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8760be982f804a9aa319b989aa1c3118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 8760be982f804a9aa319b989aa1c3118 Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-707248448 Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 14d56042415540a3b3ed06578b712ca5 Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeNegativeTest-707248448-project Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.524855 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '1a71a25f-8f53-4c71-8f61-9687de80f727'} Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:43.528418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. Oct 04 08:59:43.529808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.531259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] Returning 404 to user: Instance 1a71a25f-8f53-4c71-8f61-9687de80f727 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:43.531259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b72a7cc1-30cc-4f2f-8070-fd38792dc0c2 tempest-AttachVolumeNegativeTest-707248448 tempest-AttachVolumeNegativeTest-707248448-project] 10.222.0.27 "GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727" status: 404 len: 111 microversion: 2.1 time: 0.031413 Oct 04 08:59:43.531259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 495/993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:43 2022] GET /compute/v2.1/servers/1a71a25f-8f53-4c71-8f61-9687de80f727 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:59:43.587718 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:43.588351 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:43.594640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.595215 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.595740 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.596499 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.597059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.597578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.611710 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] HTTP exception thrown: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Request method failure captured: Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 HTTP/1.1 Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_Q1bS2Rso7HwHIxnKtH06ZGqYmE2XZ8q9NmwluJcrTAkxL9mDrTZPycDNqrTri82W3hJkvNuiQAdY4tPHd_Mk6ZO2cr9qDLYK8Q5LDJwv5e47Sl90R9a0H85ekwPytsOT90u9gOVpZ7XDPkKWGIKXPKIQOgEi1tUGMwayVNRmoHGp8 Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:43.613300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f3deef8b1cc4c9193e9357f0ba99e15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 835a297b6e75416ea9bd1a82b466b2a9 Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.615469 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'acaf703d-ba5c-4518-a5d9-afa1a34dcfd1'} Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:43.616291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.617471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.618672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Returning 404 to user: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:43.618672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-69e88f2f-c6b2-43f5-a689-11b0906da94d tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "DELETE /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 404 len: 111 microversion: 2.20 time: 0.031122 Oct 04 08:59:43.618672 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 499/994] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Oct 4 08:59:43 2022] DELETE /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:59:43.623935 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:43.624548 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] [instance: acaf703d-ba5c-4518-a5d9-afa1a34dcfd1] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:43.631138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.631790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.632240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.632944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.633401 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.633824 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.647822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] HTTP exception thrown: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Request method failure captured: Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 HTTP/1.1 Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_Q1bS2Rso7HwHIxnKtH06ZGqYmE2XZ8q9NmwluJcrTAkxL9mDrTZPycDNqrTri82W3hJkvNuiQAdY4tPHd_Mk6ZO2cr9qDLYK8Q5LDJwv5e47Sl90R9a0H85ekwPytsOT90u9gOVpZ7XDPkKWGIKXPKIQOgEi1tUGMwayVNRmoHGp8 Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:43.649359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3f3deef8b1cc4c9193e9357f0ba99e15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3f3deef8b1cc4c9193e9357f0ba99e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 3f3deef8b1cc4c9193e9357f0ba99e15 Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-943983300 Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 835a297b6e75416ea9bd1a82b466b2a9 Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeShelveTestJSON-943983300-project Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.650955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'acaf703d-ba5c-4518-a5d9-afa1a34dcfd1'} Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:43.651967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. Oct 04 08:59:43.653396 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.654854 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] Returning 404 to user: Instance acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:43.654854 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-535010f1-32fd-4cb3-9470-1164e6f561e8 tempest-AttachVolumeShelveTestJSON-943983300 tempest-AttachVolumeShelveTestJSON-943983300-project] 10.222.0.27 "GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1" status: 404 len: 111 microversion: 2.20 time: 0.030707 Oct 04 08:59:43.654854 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 496/995] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Oct 4 08:59:43 2022] GET /compute/v2.1/servers/acaf703d-ba5c-4518-a5d9-afa1a34dcfd1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 08:59:43.732899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:43.733942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:43.742046 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.742570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.743010 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.743735 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.744206 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.744693 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.760609 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] HTTP exception thrown: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Request method failure captured: Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 HTTP/1.1 Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_SQzlLLavllRtBcvrWBzjOJWRRb54TycfEAh0sjfKqdy-lija3kmdvJRwB8ULeh6hPG4-zZsUMGAWHMVmunKTLXzY5-5oEVbX3WglKvdcntub-vqMELbCa7afezD9FsnfbYylu4xO9-0044r26ZGS5cIN5fdxkhng6SeuecOKdHbXc Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:43.762493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc8433b42fb74e8bbfef92acedf01259", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: cb93504f2605489eaf50cf10930b3e46 Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.764120 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'b087fca8-b245-4d5b-8cd3-1baec0ad7560'} Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:43.764926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.766109 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.767765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Returning 404 to user: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:43.767765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f8b5f9d0-31de-4bcb-98c8-f780421d98af tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 404 len: 111 microversion: 2.1 time: 0.036785 Oct 04 08:59:43.767765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 500/996] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:43 2022] DELETE /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:43.775620 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:43.776233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] [instance: b087fca8-b245-4d5b-8cd3-1baec0ad7560] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:43.782450 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.782949 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.783385 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.784073 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:43.784745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:43.785172 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:43.799408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] HTTP exception thrown: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Request method failure captured: Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 HTTP/1.1 Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_SQzlLLavllRtBcvrWBzjOJWRRb54TycfEAh0sjfKqdy-lija3kmdvJRwB8ULeh6hPG4-zZsUMGAWHMVmunKTLXzY5-5oEVbX3WglKvdcntub-vqMELbCa7afezD9FsnfbYylu4xO9-0044r26ZGS5cIN5fdxkhng6SeuecOKdHbXc Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:43.801162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bc8433b42fb74e8bbfef92acedf01259", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bc8433b42fb74e8bbfef92acedf01259"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: bc8433b42fb74e8bbfef92acedf01259 Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-AttachVolumeTestJSON-265953721 Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: cb93504f2605489eaf50cf10930b3e46 Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-AttachVolumeTestJSON-265953721-project Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.803064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'b087fca8-b245-4d5b-8cd3-1baec0ad7560'} Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:43.803776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. Oct 04 08:59:43.804913 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:43.805988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] Returning 404 to user: Instance b087fca8-b245-4d5b-8cd3-1baec0ad7560 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:43.805988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-637f84ba-4bab-4541-b252-f3d222780cac tempest-AttachVolumeTestJSON-265953721 tempest-AttachVolumeTestJSON-265953721-project] 10.222.0.27 "GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560" status: 404 len: 111 microversion: 2.1 time: 0.032042 Oct 04 08:59:43.805988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 497/997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:43 2022] GET /compute/v2.1/servers/b087fca8-b245-4d5b-8cd3-1baec0ad7560 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:44.318099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:44.319287 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:44.327062 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:44.327809 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:44.328252 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:44.328974 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:44.329412 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:44.329875 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:44.660204 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:44.668811 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-212794a6-fe98-47ba-86b0-aab609a81bad tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1313 microversion: 2.1 time: 0.356495 Oct 04 08:59:44.669625 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 501/998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:44 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:45.693807 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:45.694498 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:45.700966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:45.701713 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:45.702146 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:45.702878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:45.703328 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:45.703751 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:46.090600 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:46.097240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2941d282-94db-4915-8129-05f5a7c2dbd9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1498 microversion: 2.1 time: 0.407871 Oct 04 08:59:46.097804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 498/999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:45 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1498 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:46.975657 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:46.976253 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:46.982756 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:46.983242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:46.983675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:46.984366 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:46.984822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:46.985246 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:47.011911 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 08:59:47.289195 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8d200af8-0297-4267-a611-a8a507875f6d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 204 len: 0 microversion: 2.1 time: 0.317321 Oct 04 08:59:47.289800 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 502/1000] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 08:59:46 2022] DELETE /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 08:59:47.298372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:47.299382 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:47.307586 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:47.308064 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:47.308704 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:47.309524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:47.309987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:47.310426 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:47.782531 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:47.799080 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2d2c6ccd-7d0f-4d59-b59f-28704a352c2d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1504 microversion: 2.1 time: 0.504480 Oct 04 08:59:47.811733 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 499/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:47 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:48.835594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:48.836908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:48.851199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:48.851747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:48.855337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:48.856310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:48.858656 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:48.859286 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:49.233057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:49.243225 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7bf3c04f-590a-4bcf-91a9-62c720cc58f9 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1504 microversion: 2.1 time: 0.413397 Oct 04 08:59:49.246491 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 503/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:48 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:49.602568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-c6b69923-ac12-40bd-9a3a-b48c2a8b647e req-c04dc422-5b8b-4dfa-833f-0bc0d96b7dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9899c0dc-ffc8-4077-ae74-626c92ef357b", "name": "network-vif-deleted", "tag": "910bb228-653c-42c4-9692-f08bf4a007b7"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:49.615418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-c6b69923-ac12-40bd-9a3a-b48c2a8b647e req-c04dc422-5b8b-4dfa-833f-0bc0d96b7dea service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:49.616326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-c6b69923-ac12-40bd-9a3a-b48c2a8b647e req-c04dc422-5b8b-4dfa-833f-0bc0d96b7dea service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:49.616822 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-c6b69923-ac12-40bd-9a3a-b48c2a8b647e req-c04dc422-5b8b-4dfa-833f-0bc0d96b7dea service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:49.628608 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-c6b69923-ac12-40bd-9a3a-b48c2a8b647e req-c04dc422-5b8b-4dfa-833f-0bc0d96b7dea service nova] Creating event network-vif-deleted:910bb228-653c-42c4-9692-f08bf4a007b7 for instance 9899c0dc-ffc8-4077-ae74-626c92ef357b on hv-cinder-85944 Oct 04 08:59:49.635299 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-c6b69923-ac12-40bd-9a3a-b48c2a8b647e req-c04dc422-5b8b-4dfa-833f-0bc0d96b7dea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036521 Oct 04 08:59:49.638356 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 500/1003] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:50.269813 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:50.273158 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:50.289658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:50.290778 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:50.291531 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:50.292736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:50.293458 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:50.295285 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:50.472888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:50.473378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:50.473907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:50.474951 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lazy-loading 'fault' on Instance uuid 9899c0dc-ffc8-4077-ae74-626c92ef357b {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 08:59:50.541961 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:50.563561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a2737cee-24c1-4e6e-847e-98f2bca5aa4b tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 200 len: 1303 microversion: 2.1 time: 0.299986 Oct 04 08:59:50.564251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 504/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:50 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 1303 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:51.592371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:51.593123 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: 9899c0dc-ffc8-4077-ae74-626c92ef357b] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:51.602269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:51.602892 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:51.603597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:51.604313 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:51.604775 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:51.608525 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:51.614086 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=100 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:51.625129 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] HTTP exception thrown: Instance 9899c0dc-ffc8-4077-ae74-626c92ef357b could not be found. Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Request method failure captured: Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b HTTP/1.1 Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_XvQWAyZO_NZsjPNNDGqmktQKluamfsc5T32B7y6vDlcyaBJlbttHEMi2GfeAhwG0oGcWA0KAzFu3GGQt7HfuT5GVBlZQ5Nf6L9HKgLl6WFdMwJ1tCshBKbbFD8zsd2r_-RfwxaIBRt9A260lpU1dg2AjMvJaeb1YzMUp6uOFospWc Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: f9e5915b40b84a859f5ab0fb5892c973 Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-VolumesActionsTest-1121719000 Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 08:59:51.626847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9e5915b40b84a859f5ab0fb5892c973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9e5915b40b84a859f5ab0fb5892c973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9e5915b40b84a859f5ab0fb5892c973", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9e5915b40b84a859f5ab0fb5892c973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-VolumesActionsTest-1121719000 Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: f9e5915b40b84a859f5ab0fb5892c973 Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-VolumesActionsTest-1121719000 Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-VolumesActionsTest-1121719000-project Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 6027a9e1cfe74099a92eb3b39ce6361b Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-VolumesActionsTest-1121719000-project Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 9899c0dc-ffc8-4077-ae74-626c92ef357b could not be found. Oct 04 08:59:51.628567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '9899c0dc-ffc8-4077-ae74-626c92ef357b'} Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9899c0dc-ffc8-4077-ae74-626c92ef357b could not be found. Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:51.629580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9899c0dc-ffc8-4077-ae74-626c92ef357b could not be found. Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9899c0dc-ffc8-4077-ae74-626c92ef357b could not be found. Oct 04 08:59:51.631269 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 08:59:51.633387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Returning 404 to user: Instance 9899c0dc-ffc8-4077-ae74-626c92ef357b could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:51.634270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6ddd9ef9-9eb8-494a-801b-6257d6a6f486 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b" status: 404 len: 111 microversion: 2.1 time: 0.047403 Oct 04 08:59:51.634939 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 501/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:51 2022] GET /compute/v2.1/servers/9899c0dc-ffc8-4077-ae74-626c92ef357b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:51.749533 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1075803752", "imageRef": "448019bb-2187-41b8-a11b-5ba2447de25b", "flavorRef": "452", "networks": [{"uuid": "b6baeb7f-3d3d-4aed-b922-058db1f05b2c"}]}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:51.821528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] validate_networks() for [('b6baeb7f-3d3d-4aed-b922-058db1f05b2c', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 08:59:52.365880 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 08:59:52.366496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 08:59:52.367186 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 08:59:52.367776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 08:59:52.368295 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 08:59:52.377458 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:52.378774 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:52.379291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:52.380086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:52.381345 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:52.381844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:52.403107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Getting quotas for project f9e5915b40b84a859f5ab0fb5892c973. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 08:59:52.407164 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Getting quotas for user 6027a9e1cfe74099a92eb3b39ce6361b and project f9e5915b40b84a859f5ab0fb5892c973. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 08:59:52.418054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 08:59:52.420384 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='448019bb-2187-41b8-a11b-5ba2447de25b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 08:59:52.569893 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-18c2c3d8-634d-4e85-b8d1-0a44a89e49ec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824334 Oct 04 08:59:52.571206 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 505/1006] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 08:59:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 08:59:52.583936 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-efca7b1c-38b4-4e30-b165-0c67bcd6bfec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:52.586127 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-efca7b1c-38b4-4e30-b165-0c67bcd6bfec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:52.646649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-efca7b1c-38b4-4e30-b165-0c67bcd6bfec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:52.654503 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-efca7b1c-38b4-4e30-b165-0c67bcd6bfec tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1214 microversion: 2.1 time: 0.074954 Oct 04 08:59:52.655207 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 506/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:52 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:52.773220 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1ca1f395-1116-4514-8981-3f5e570bd292 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Action: 'create', calling method: .version_select at 0x7f6f1a4feee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-152786883"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:53.552848 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1ca1f395-1116-4514-8981-3f5e570bd292 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.083071 Oct 04 08:59:53.553703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 502/1008] 10.222.0.27 () {60 vars in 1155 bytes} [Tue Oct 4 08:59:52 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1085 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 04 08:59:53.567004 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-eaad7716-3b0d-427d-a7c5-dedfa7f6d272 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a47adc0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:53.622793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-eaad7716-3b0d-427d-a7c5-dedfa7f6d272 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 200 len: 344 microversion: 2.1 time: 0.058711 Oct 04 08:59:53.622793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 507/1009] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:59:53 2022] GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:53.679154 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:53.679871 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:53.689926 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:53.691186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:53.692553 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:53.697584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:53.702494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:53.702494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:53.783021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:53.791668 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0ff750d3-c2e3-4486-99c8-14465b5cbd27 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1218 microversion: 2.1 time: 0.118110 Oct 04 08:59:53.792236 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 503/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:53 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:54.637135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-201fff39-4551-4835-98c7-4009e9c562a4 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a5a9af0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:54.683883 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-201fff39-4551-4835-98c7-4009e9c562a4 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 200 len: 345 microversion: 2.1 time: 0.051039 Oct 04 08:59:54.684451 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 508/1011] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:59:54 2022] GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:54.697966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-243f1ac1-721b-4637-a655-193a225c3a47 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Action: 'create', calling method: .version_select at 0x7f6f1b29f040>, body: {"snapshot": {"volume_id": "1a12552a-a5f4-4ef7-9fc8-418d53860c73", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-962139632"}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:54.814788 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:54.815399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:54.822473 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:54.822957 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:54.823583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:54.824273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:54.824890 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:54.825315 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:54.934540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:54.953147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9c0a6c68-95a2-4b4b-8e26-e969f4227347 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1274 microversion: 2.1 time: 0.141567 Oct 04 08:59:54.954980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 509/1012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:54 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 08:59:55.177645 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-243f1ac1-721b-4637-a655-193a225c3a47 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.482822 Oct 04 08:59:55.178319 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 504/1013] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Oct 4 08:59:54 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:55.189801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-039e7498-2b85-457e-9d2d-4624ffbe9031 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a307a60>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:55.225601 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-039e7498-2b85-457e-9d2d-4624ffbe9031 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a" status: 200 len: 286 microversion: 2.1 time: 0.039602 Oct 04 08:59:55.226513 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 510/1014] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 4 08:59:55 2022] GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:55.237343 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8f1cea97-7511-475c-9e5f-3894b6695b59 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a52f8b0>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:55.284017 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8f1cea97-7511-475c-9e5f-3894b6695b59 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.050395 Oct 04 08:59:55.284595 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 505/1015] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Oct 4 08:59:55 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:55.298226 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e90e6c9f-415d-49a2-8836-d6c65402ced2 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a492d30>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:55.331279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e90e6c9f-415d-49a2-8836-d6c65402ced2 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a" status: 200 len: 286 microversion: 2.1 time: 0.036980 Oct 04 08:59:55.331851 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 511/1016] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 4 08:59:55 2022] GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:55.980647 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:55.981258 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:55.987200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:55.987716 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:55.988153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:55.988862 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:55.989314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:55.989853 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:56.122529 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:56.130174 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7a579f66-c77e-49ec-ad8e-e31d2107acfc tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.154676 Oct 04 08:59:56.130763 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 506/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:55 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:56.344706 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a14187c8-78b3-49ad-a0cb-8cdd0c2e80a9 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a3db160>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:56.379003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a14187c8-78b3-49ad-a0cb-8cdd0c2e80a9 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a" status: 200 len: 286 microversion: 2.1 time: 0.037973 Oct 04 08:59:56.379597 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 512/1018] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 4 08:59:56 2022] GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:57.154463 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:57.154991 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:57.161303 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:57.161824 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:57.162256 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:57.162971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:57.163425 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:57.163873 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:57.300608 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:57.308946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e42f00fc-0395-45c5-97b4-7876db25eb01 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.158511 Oct 04 08:59:57.309682 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 507/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:57 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:57.392747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c2342302-0ba5-43f2-8e09-87f301c3b80d tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a307d30>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:57.422079 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c2342302-0ba5-43f2-8e09-87f301c3b80d tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a" status: 200 len: 286 microversion: 2.1 time: 0.033912 Oct 04 08:59:57.422682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 513/1020] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 4 08:59:57 2022] GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:58.333882 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:58.335797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:58.342595 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:58.343083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:58.343518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:58.344217 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:58.344720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:58.345150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:58.436105 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3ec8f624-2e36-4df5-a38d-b49a3b65cc59 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a63b280>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:58.470822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3ec8f624-2e36-4df5-a38d-b49a3b65cc59 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a" status: 200 len: 287 microversion: 2.1 time: 0.038945 Oct 04 08:59:58.471421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 514/1021] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 4 08:59:58 2022] GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:59:58.483424 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f1457a16-4bf0-4deb-87f3-9c8cc6c7e6e6 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a616940>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:58.489060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:58.500206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9839e6f7-8fc9-4613-9c19-c8a215545134 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.170854 Oct 04 08:59:58.501077 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 508/1022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:58 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:58.610123 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f1457a16-4bf0-4deb-87f3-9c8cc6c7e6e6 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a" status: 202 len: 0 microversion: 2.1 time: 0.130746 Oct 04 08:59:58.610734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 515/1023] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Oct 4 08:59:58 2022] DELETE /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 08:59:58.619461 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-7a5fd2f3-e061-4342-a6c5-4bb144fd24a1 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a3d5940>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:58.654916 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-7a5fd2f3-e061-4342-a6c5-4bb144fd24a1 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a" status: 200 len: 286 microversion: 2.1 time: 0.039158 Oct 04 08:59:58.655482 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 509/1024] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 4 08:59:58 2022] GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 08:59:58.894150 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-7b5c6567-18ad-4d1c-850b-6a7f1e07ffa9 req-3ab85eec-e63a-41fa-a213-564686a2c3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40582cb-3bf2-4e2c-b4ec-50c14ab176bd", "tag": "bc5cb1e6-e616-46b1-baa2-cc1c98587dac"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 08:59:58.913724 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-7b5c6567-18ad-4d1c-850b-6a7f1e07ffa9 req-3ab85eec-e63a-41fa-a213-564686a2c3a4 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:58.914200 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-7b5c6567-18ad-4d1c-850b-6a7f1e07ffa9 req-3ab85eec-e63a-41fa-a213-564686a2c3a4 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:58.914655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-7b5c6567-18ad-4d1c-850b-6a7f1e07ffa9 req-3ab85eec-e63a-41fa-a213-564686a2c3a4 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:58.926279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-7b5c6567-18ad-4d1c-850b-6a7f1e07ffa9 req-3ab85eec-e63a-41fa-a213-564686a2c3a4 service nova] Creating event network-changed:bc5cb1e6-e616-46b1-baa2-cc1c98587dac for instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd on hv-cinder-85944 Oct 04 08:59:58.932459 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-7b5c6567-18ad-4d1c-850b-6a7f1e07ffa9 req-3ab85eec-e63a-41fa-a213-564686a2c3a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041887 Oct 04 08:59:58.933384 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 516/1025] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 08:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 08:59:59.528777 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:59.529383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 08:59:59.535451 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:59.535934 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:59.537017 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:59.537793 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 08:59:59.538238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 08:59:59.538757 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 08:59:59.669071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-168a8325-4717-4c88-b7fc-7119840c8f25 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a4a65e0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:59.674104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 08:59:59.683044 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8c0765a5-bc41-4bc3-a690-5ea54f5434cb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.158592 Oct 04 08:59:59.683615 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 510/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 08:59:59 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 08:59:59.700535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-168a8325-4717-4c88-b7fc-7119840c8f25 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] HTTP exception thrown: Snapshot d9a6e919-04d5-4995-9772-f7900617185a could not be found. Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-168a8325-4717-4c88-b7fc-7119840c8f25 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Request method failure captured: Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a HTTP/1.1 Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_YIpEI-DrlvWb1ViA0CogMBAmD2Hs1HbRkNQWWbVg_GUw4HZidxUusUbNvR-07MCUbppLL1lNJVh8di4VXGBH3UUkeqtjSD65MYnma_iZ7QGtyZCQMGuJNcyml5FsBJx3-bfFgjaPO2XoZy4lMGFc0O6j3JA4n5vd_m9D5w3G1ghm0 Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: f8320aa7c44c44c59ca0337aa84c2f2d Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 08:59:59.703196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8320aa7c44c44c59ca0337aa84c2f2d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: f8320aa7c44c44c59ca0337aa84c2f2d Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesSnapshotsTestJSON-1111193153-project Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 9f175b352f4240b5923331008dd49cd7 Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1111193153-project Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Snapshot d9a6e919-04d5-4995-9772-f7900617185a could not be found. Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'd9a6e919-04d5-4995-9772-f7900617185a'} Oct 04 08:59:59.704761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d9a6e919-04d5-4995-9772-f7900617185a could not be found. (HTTP 404) (Request-ID: req-9c14cefa-ef8d-4796-9b3d-cf82dcb3ad79) Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:59.705806 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 08:59:59.707236 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d9a6e919-04d5-4995-9772-f7900617185a could not be found. Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 08:59:59.709251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d9a6e919-04d5-4995-9772-f7900617185a could not be found. Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d9a6e919-04d5-4995-9772-f7900617185a could not be found. Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-168a8325-4717-4c88-b7fc-7119840c8f25 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Returning 404 to user: Snapshot d9a6e919-04d5-4995-9772-f7900617185a could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 08:59:59.710738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-168a8325-4717-4c88-b7fc-7119840c8f25 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a" status: 404 len: 111 microversion: 2.1 time: 0.040652 Oct 04 08:59:59.711671 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 517/1027] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 4 08:59:59 2022] GET /compute/v2.1/os-snapshots/d9a6e919-04d5-4995-9772-f7900617185a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 08:59:59.714385 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-77408e96-d383-4608-a3da-ca90d396fa06 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a89fee0>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:59.910720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-77408e96-d383-4608-a3da-ca90d396fa06 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 202 len: 0 microversion: 2.1 time: 0.199974 Oct 04 08:59:59.911301 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 511/1028] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 08:59:59 2022] DELETE /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 08:59:59.919566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bb948538-40f5-471e-9e49-f51ddef84182 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a4009d0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 08:59:59.967231 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bb948538-40f5-471e-9e49-f51ddef84182 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 200 len: 344 microversion: 2.1 time: 0.051559 Oct 04 08:59:59.967785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 518/1029] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 08:59:59 2022] GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:00.707710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:00.708971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:00.714944 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:00.715428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:00.715859 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:00.716538 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:00.716986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:00.717404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:00.842716 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:00.851609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d8b79ba3-14b9-4b9b-bd26-44a3ce9358f7 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.148166 Oct 04 09:00:00.852181 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 512/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:00 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:00.982278 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a453ab27-e41d-463e-9de2-392c4f8626e9 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a334a60>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:01.030061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a453ab27-e41d-463e-9de2-392c4f8626e9 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 200 len: 344 microversion: 2.1 time: 0.052013 Oct 04 09:00:01.030687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 519/1031] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 09:00:00 2022] GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:01.878940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:01.879555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:01.886086 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:01.886601 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:01.887037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:01.887728 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:01.888181 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:01.888873 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:02.023402 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:02.031385 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-015a9b4e-2edf-4fd9-913a-716533546462 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.156291 Oct 04 09:00:02.031953 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 513/1032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:01 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:02.045690 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-d245706a-8f72-455c-ad91-08289ab64bd1 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a5a9700>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:02.092410 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-d245706a-8f72-455c-ad91-08289ab64bd1 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 200 len: 344 microversion: 2.1 time: 0.050368 Oct 04 09:00:02.092410 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 520/1033] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 09:00:02 2022] GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:03.055591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:03.056201 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:03.062740 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:03.063567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:03.063678 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:03.064271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:03.064720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:03.065605 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:03.117214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a6f54297-0743-45e8-91a4-22b2d88ff5f6 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a2beee0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:03.127444 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:03.128378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=8 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:03.156369 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-a6f54297-0743-45e8-91a4-22b2d88ff5f6 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] HTTP exception thrown: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a6f54297-0743-45e8-91a4-22b2d88ff5f6 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Request method failure captured: Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 HTTP/1.1 Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_YIpEI-DrlvWb1ViA0CogMBAmD2Hs1HbRkNQWWbVg_GUw4HZidxUusUbNvR-07MCUbppLL1lNJVh8di4VXGBH3UUkeqtjSD65MYnma_iZ7QGtyZCQMGuJNcyml5FsBJx3-bfFgjaPO2XoZy4lMGFc0O6j3JA4n5vd_m9D5w3G1ghm0 Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: f8320aa7c44c44c59ca0337aa84c2f2d Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 09:00:03.160643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8320aa7c44c44c59ca0337aa84c2f2d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: f8320aa7c44c44c59ca0337aa84c2f2d Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesSnapshotsTestJSON-1111193153-project Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 9f175b352f4240b5923331008dd49cd7 Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1111193153-project Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '1a12552a-a5f4-4ef7-9fc8-418d53860c73'} Oct 04 09:00:03.162355 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. (HTTP 404) (Request-ID: req-2a377d39-3d7b-4299-a0a8-20c2a53fa492) Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.163337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 09:00:03.164822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 09:00:03.166725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.168099 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.170035 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a6f54297-0743-45e8-91a4-22b2d88ff5f6 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Returning 404 to user: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:03.171086 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a6f54297-0743-45e8-91a4-22b2d88ff5f6 tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 404 len: 109 microversion: 2.1 time: 0.068960 Oct 04 09:00:03.171802 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 521/1034] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 09:00:03 2022] GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 09:00:03.187606 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f28f831f-d1b5-4c52-8e4e-699617057ccc tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a63b280>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:03.222329 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:03.229567 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-681bdc8a-66b7-484c-98fc-80793b7c5092 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.178291 Oct 04 09:00:03.230223 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 514/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:03 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:03.257747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-f28f831f-d1b5-4c52-8e4e-699617057ccc tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] HTTP exception thrown: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f28f831f-d1b5-4c52-8e4e-699617057ccc tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Request method failure captured: Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 HTTP/1.1 Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_YIpEI-DrlvWb1ViA0CogMBAmD2Hs1HbRkNQWWbVg_GUw4HZidxUusUbNvR-07MCUbppLL1lNJVh8di4VXGBH3UUkeqtjSD65MYnma_iZ7QGtyZCQMGuJNcyml5FsBJx3-bfFgjaPO2XoZy4lMGFc0O6j3JA4n5vd_m9D5w3G1ghm0 Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: f8320aa7c44c44c59ca0337aa84c2f2d Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 09:00:03.259683 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8320aa7c44c44c59ca0337aa84c2f2d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: f8320aa7c44c44c59ca0337aa84c2f2d Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesSnapshotsTestJSON-1111193153-project Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 9f175b352f4240b5923331008dd49cd7 Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1111193153-project Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '1a12552a-a5f4-4ef7-9fc8-418d53860c73'} Oct 04 09:00:03.266059 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. (HTTP 404) (Request-ID: req-0f6289f0-7f73-4f05-ac45-639960e927ce) Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.267495 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 09:00:03.268865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 09:00:03.270193 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f28f831f-d1b5-4c52-8e4e-699617057ccc tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Returning 404 to user: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:03.271845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f28f831f-d1b5-4c52-8e4e-699617057ccc tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 404 len: 109 microversion: 2.1 time: 0.078974 Oct 04 09:00:03.272978 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 522/1036] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Oct 4 09:00:03 2022] DELETE /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 09:00:03.278225 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e6d64134-24a3-484d-9fc9-7d8417af2cfe tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Calling method '.version_select at 0x7f6f1a491f70>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:03.310610 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-e6d64134-24a3-484d-9fc9-7d8417af2cfe tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] HTTP exception thrown: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e6d64134-24a3-484d-9fc9-7d8417af2cfe tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Request method failure captured: Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 HTTP/1.1 Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_YIpEI-DrlvWb1ViA0CogMBAmD2Hs1HbRkNQWWbVg_GUw4HZidxUusUbNvR-07MCUbppLL1lNJVh8di4VXGBH3UUkeqtjSD65MYnma_iZ7QGtyZCQMGuJNcyml5FsBJx3-bfFgjaPO2XoZy4lMGFc0O6j3JA4n5vd_m9D5w3G1ghm0 Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: f8320aa7c44c44c59ca0337aa84c2f2d Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 09:00:03.312555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f8320aa7c44c44c59ca0337aa84c2f2d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f8320aa7c44c44c59ca0337aa84c2f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: f8320aa7c44c44c59ca0337aa84c2f2d Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1111193153 Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-VolumesSnapshotsTestJSON-1111193153-project Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 9f175b352f4240b5923331008dd49cd7 Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1111193153-project Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '1a12552a-a5f4-4ef7-9fc8-418d53860c73'} Oct 04 09:00:03.313972 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. (HTTP 404) (Request-ID: req-2bad3b27-1adb-4dd9-a895-1d64a8ca2ae9) Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.321685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 09:00:03.323104 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 09:00:03.324503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e6d64134-24a3-484d-9fc9-7d8417af2cfe tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] Returning 404 to user: Volume 1a12552a-a5f4-4ef7-9fc8-418d53860c73 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e6d64134-24a3-484d-9fc9-7d8417af2cfe tempest-VolumesSnapshotsTestJSON-1111193153 tempest-VolumesSnapshotsTestJSON-1111193153-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73" status: 404 len: 109 microversion: 2.1 time: 0.039664 Oct 04 09:00:03.326305 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 515/1037] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Oct 4 09:00:03 2022] GET /compute/v2.1/os-volumes/1a12552a-a5f4-4ef7-9fc8-418d53860c73 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:00:04.253929 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:04.255817 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:04.262429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:04.263173 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:04.263933 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:04.264862 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:04.265514 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:04.265940 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:04.409840 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:04.418247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6ccb7001-8fe2-4305-8a77-55d050ece238 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.169552 Oct 04 09:00:04.418830 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 523/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:04 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:05.442052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:05.443280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:05.450318 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:05.450860 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:05.451299 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:05.451998 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:05.452789 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:05.453218 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:05.586558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:05.594162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fd25435e-efe0-4c68-8269-d138e31710d0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.156380 Oct 04 09:00:05.594745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 516/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:05 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:06.287149 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-74a1f3e9-2afc-4f2c-abf7-e88bcee3d5c1 req-bac7befa-4cdf-4282-85eb-4a5242a08af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40582cb-3bf2-4e2c-b4ec-50c14ab176bd", "name": "network-vif-plugged", "status": "completed", "tag": "bc5cb1e6-e616-46b1-baa2-cc1c98587dac"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:06.310582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-74a1f3e9-2afc-4f2c-abf7-e88bcee3d5c1 req-bac7befa-4cdf-4282-85eb-4a5242a08af2 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:06.310582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-74a1f3e9-2afc-4f2c-abf7-e88bcee3d5c1 req-bac7befa-4cdf-4282-85eb-4a5242a08af2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:06.310582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-74a1f3e9-2afc-4f2c-abf7-e88bcee3d5c1 req-bac7befa-4cdf-4282-85eb-4a5242a08af2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:06.319363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-74a1f3e9-2afc-4f2c-abf7-e88bcee3d5c1 req-bac7befa-4cdf-4282-85eb-4a5242a08af2 service nova] Creating event network-vif-plugged:bc5cb1e6-e616-46b1-baa2-cc1c98587dac for instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd on hv-cinder-85944 Oct 04 09:00:06.324678 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-74a1f3e9-2afc-4f2c-abf7-e88bcee3d5c1 req-bac7befa-4cdf-4282-85eb-4a5242a08af2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043932 Oct 04 09:00:06.325285 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 524/1040] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:06.618644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:06.621148 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:06.628903 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:06.628903 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:06.628903 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:06.628903 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:06.629516 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:06.642800 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:06.847364 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:06.855474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-6e9d2305-d54f-47a3-b9bf-dff438d90c0e tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1314 microversion: 2.1 time: 0.242157 Oct 04 09:00:06.856036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 517/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:06 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:07.877987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:07.878734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:07.884994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:07.885475 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:07.885909 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:07.886615 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:07.887068 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:07.887490 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:08.045640 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:08.057785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-13c5a157-c2c7-40d4-b17a-2894b41fa74d tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1498 microversion: 2.1 time: 0.183887 Oct 04 09:00:08.061188 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 525/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:07 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1498 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:09.236537 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:09.237351 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:09.247697 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:09.248200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:09.248641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:09.249349 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:09.249869 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:09.250223 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:09.295421 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:00:09.843280 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a6dfff4b-a52e-4a2c-b59f-c711b3c1dfc4 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 204 len: 0 microversion: 2.1 time: 0.611637 Oct 04 09:00:09.843973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 518/1043] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 09:00:09 2022] DELETE /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:00:09.853765 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:09.854341 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:09.860578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:09.861340 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:09.861793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:09.862577 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:09.863043 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:09.863475 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:10.015520 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:10.024624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-87235d6d-3055-4316-a95f-bc6d906bcccb tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1504 microversion: 2.1 time: 0.176410 Oct 04 09:00:10.025204 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 526/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:09 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:00:11.048392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:11.049117 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:11.056216 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:11.056703 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:11.057177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:11.057827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:11.058282 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:11.058736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:11.192958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:11.201029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cf508a36-369d-4cc1-9c92-f763ec3a1d37 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1504 microversion: 2.1 time: 0.156875 Oct 04 09:00:11.201923 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 519/1045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:11 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:11.677406 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-b60bf63f-a0ca-42d6-a178-ade459ba0cc7 req-a2e12509-55db-4af0-aaef-f968b0610b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40582cb-3bf2-4e2c-b4ec-50c14ab176bd", "name": "network-vif-deleted", "tag": "bc5cb1e6-e616-46b1-baa2-cc1c98587dac"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:11.687538 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b60bf63f-a0ca-42d6-a178-ade459ba0cc7 req-a2e12509-55db-4af0-aaef-f968b0610b51 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:11.687995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b60bf63f-a0ca-42d6-a178-ade459ba0cc7 req-a2e12509-55db-4af0-aaef-f968b0610b51 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:11.693273 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b60bf63f-a0ca-42d6-a178-ade459ba0cc7 req-a2e12509-55db-4af0-aaef-f968b0610b51 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:11.701444 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-b60bf63f-a0ca-42d6-a178-ade459ba0cc7 req-a2e12509-55db-4af0-aaef-f968b0610b51 service nova] Creating event network-vif-deleted:bc5cb1e6-e616-46b1-baa2-cc1c98587dac for instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd on hv-cinder-85944 Oct 04 09:00:11.706316 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-b60bf63f-a0ca-42d6-a178-ade459ba0cc7 req-a2e12509-55db-4af0-aaef-f968b0610b51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Oct 04 09:00:11.706948 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 527/1046] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:00:12.225778 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:12.226389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:12.228897 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:12.233488 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:12.234036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:12.234483 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:12.235177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:12.235626 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:12.236049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:12.302660 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:12.310683 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-eacdf669-c518-40c5-8888-493951ad2dbf tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1462 microversion: 2.1 time: 0.089681 Oct 04 09:00:12.311256 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 520/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:12 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:13.335680 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:13.336378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:13.338337 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:13.343459 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:13.343941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:13.344372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:13.345047 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:13.345496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:13.345916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:13.350783 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:13.414278 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:13.421865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5a9be7d2-9437-488b-b314-fc9ae0822ca0 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1462 microversion: 2.1 time: 0.091195 Oct 04 09:00:13.422538 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 528/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:13 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:14.448076 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:14.450133 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:14.460626 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:14.461057 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:14.461626 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:14.462473 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:14.463152 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:14.463772 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:14.508030 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:14.508531 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:14.509343 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:14.509817 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lazy-loading 'fault' on Instance uuid a40582cb-3bf2-4e2c-b4ec-50c14ab176bd {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:00:14.555197 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6027a9e1cfe74099a92eb3b39ce6361b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5915b40b84a859f5ab0fb5892c973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:14.565692 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1dc6c203-4c2a-4d45-a689-0584ed8d588c tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 200 len: 1304 microversion: 2.1 time: 0.124199 Oct 04 09:00:14.566517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 521/1049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:14 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:00:15.591003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:15.591520 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] [instance: a40582cb-3bf2-4e2c-b4ec-50c14ab176bd] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:15.599330 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:15.599940 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:15.600411 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:15.601122 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:15.601570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:15.602008 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:15.617855 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] HTTP exception thrown: Instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd could not be found. Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Request method failure captured: Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd HTTP/1.1 Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_XvQWAyZO_NZsjPNNDGqmktQKluamfsc5T32B7y6vDlcyaBJlbttHEMi2GfeAhwG0oGcWA0KAzFu3GGQt7HfuT5GVBlZQ5Nf6L9HKgLl6WFdMwJ1tCshBKbbFD8zsd2r_-RfwxaIBRt9A260lpU1dg2AjMvJaeb1YzMUp6uOFospWc Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: f9e5915b40b84a859f5ab0fb5892c973 Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-VolumesActionsTest-1121719000 Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 09:00:15.619470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f9e5915b40b84a859f5ab0fb5892c973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9e5915b40b84a859f5ab0fb5892c973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f9e5915b40b84a859f5ab0fb5892c973", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f9e5915b40b84a859f5ab0fb5892c973"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-VolumesActionsTest-1121719000 Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: f9e5915b40b84a859f5ab0fb5892c973 Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-VolumesActionsTest-1121719000 Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-VolumesActionsTest-1121719000-project Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 6027a9e1cfe74099a92eb3b39ce6361b Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-VolumesActionsTest-1121719000-project Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd could not be found. Oct 04 09:00:15.621179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': 'a40582cb-3bf2-4e2c-b4ec-50c14ab176bd'} Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd could not be found. Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:00:15.622643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd could not be found. Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd could not be found. Oct 04 09:00:15.623920 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:00:15.625188 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] Returning 404 to user: Instance a40582cb-3bf2-4e2c-b4ec-50c14ab176bd could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:00:15.625188 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8a98fa28-4e4d-4513-82e4-ba48b5b3b8d1 tempest-VolumesActionsTest-1121719000 tempest-VolumesActionsTest-1121719000-project] 10.222.0.27 "GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd" status: 404 len: 111 microversion: 2.1 time: 0.034155 Oct 04 09:00:15.625188 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 529/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:15 2022] GET /compute/v2.1/servers/a40582cb-3bf2-4e2c-b4ec-50c14ab176bd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:00:54.714529 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:00:54.719546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:54.719546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=5 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:54.719546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:54.725379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:54.725875 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:54.726316 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:54.727076 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:54.727602 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:54.727945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:54.812378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.objects.instance [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lazy-loading 'flavor' on Instance uuid 0da2fd17-4355-438b-a667-e7881a655fe2 {{(pid=127549) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:00:55.246940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d7a24d2d-e107-4bba-9e2c-7920c381cd97 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "POST /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2/action" status: 202 len: 0 microversion: 2.1 time: 0.536009 Oct 04 09:00:55.248165 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 522/1051] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 09:00:54 2022] POST /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:00:55.258425 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:55.259736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:55.271912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:00:55.279950 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Tue Oct 4 09:00:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 (ip 10.222.0.27) !!! Oct 04 09:00:55.289623 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:55.290116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:55.290582 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:55.291794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:55.292707 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:55.293342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:55.468730 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:55.478230 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-93c93344-70ab-49fc-bd85-f03c59e460fe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.223853 Oct 04 09:00:55.478844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 530/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:55 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:56.506392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:56.507808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:56.524137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:56.527015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:56.527746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:56.530491 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:56.532516 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:56.533830 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:56.837143 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:56.852072 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d630e169-423c-442e-beda-6255e5302330 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.351661 Oct 04 09:00:56.866595 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 523/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:56 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:57.885908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:57.887622 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:57.896856 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:57.898037 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:57.898768 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:57.899665 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:57.900302 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:57.900918 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:58.129557 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:58.139774 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6e953787-dc1e-4ebf-a843-95babc051d73 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.261940 Oct 04 09:00:58.140928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 531/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:57 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:00:59.164016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:00:59.164658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:00:59.171572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:59.172141 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:59.172594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:59.173304 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:00:59.173764 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:00:59.174260 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:00:59.311359 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:00:59.322121 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2bf0507a-4a46-43b1-b79e-fa7cc7485fa6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.162319 Oct 04 09:00:59.322721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 524/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:00:59 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:01:00.347148 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:00.348118 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:00.355526 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:00.361006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:00.361006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:00.361006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:00.361006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:00.361375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:00.577282 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:00.589094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-010c77e6-306a-405f-89bc-7cfdd4799144 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.247375 Oct 04 09:01:00.590040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 532/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:00 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:01.613760 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:01.614393 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:01.621409 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:01.622188 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:01.622865 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:01.623736 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:01.624354 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:01.624966 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:01.835504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:01.845100 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-d5b7d516-e343-46ed-b788-b26902c06d74 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.236733 Oct 04 09:01:01.845649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 525/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:01 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:02.869450 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:02.870926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:02.878359 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:02.879187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:02.879625 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:02.880359 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:02.880820 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:02.881240 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:03.126471 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:03.139914 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-71c93410-ac90-4640-8bf3-4b45b7f623bc tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.272304 Oct 04 09:01:03.141833 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 533/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:02 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:04.166148 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:04.166805 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:04.180719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:04.180719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:04.180719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:04.182784 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:04.183572 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:04.184129 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:04.442360 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:04.452442 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-5222f099-5ce1-4d96-aba8-98bc613a048a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.290870 Oct 04 09:01:04.468246 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 526/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:04 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:05.476061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:05.476865 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:05.484395 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:05.485239 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:05.485930 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:05.486821 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:05.487519 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:05.488270 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:05.782592 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:05.793685 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a5f82ebe-fb36-45d0-b76c-7b6465d01dbe tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.321791 Oct 04 09:01:05.794455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 534/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:05 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:06.722368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-31afeeae-88b1-40bb-b538-c0ef19ced956 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Action: 'create', calling method: .version_select at 0x7f6f1a5460d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-850828242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBceifcGvsUmrTN45GwlVok87MhsRcX57Eo18TGdT+3+M+SACt++/g3jU0eQADVcKPxXc4ULiMS1hD7RtFjhM1HTacDmQxP+Vzez1lAR6RN9Aexy+v22EXxxrZ2GOTYXWw=="}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:06.740177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-31afeeae-88b1-40bb-b538-c0ef19ced956 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Getting quotas for project 07b9220d86234adc83ef7fbe0d4d834d. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:01:06.744340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-31afeeae-88b1-40bb-b538-c0ef19ced956 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Getting quotas for user 471299b556bd4c22b51defc14b49d8eb and project 07b9220d86234adc83ef7fbe0d4d834d. Resources: {'key_pairs'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:01:06.820745 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:06.822034 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:06.822162 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-31afeeae-88b1-40bb-b538-c0ef19ced956 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.308126 Oct 04 09:01:06.822832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 527/1061] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Oct 4 09:01:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:06.830526 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:06.831136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:06.831554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:06.832285 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:06.832804 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:06.833465 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:06.999805 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:07.010908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-83fe0abb-79d1-4ffb-9d44-a4ca43d4e4cf tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.194843 Oct 04 09:01:07.011807 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 535/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:06 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:08.036465 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:08.037195 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:08.045719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:08.046794 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:08.047502 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:08.048476 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:08.049368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:08.050136 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:08.222389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:08.242001 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-de1f2410-dd2b-4b80-96ce-581e2b5ed82b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.210860 Oct 04 09:01:08.244769 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 528/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:08 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:09.279707 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:09.279707 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:09.283460 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:09.284245 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:09.284905 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:09.285699 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:09.286389 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:09.287050 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:09.487981 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:09.496507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f22d4258-af05-4f83-8793-0e1ae44435d6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.229193 Oct 04 09:01:09.497385 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 536/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:09 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:10.521036 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:10.522652 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:10.529898 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:10.530392 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:10.530930 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:10.531650 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:10.532111 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:10.532538 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:10.670555 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:10.679177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-ed9a7f20-b1ee-4880-a105-ab8f2937ff51 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.162113 Oct 04 09:01:10.679918 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 529/1065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:10 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:11.704041 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:11.704757 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:11.715566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:11.716621 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:11.717722 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:11.718486 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:11.718958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:11.719388 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:11.886863 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:11.906297 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-93a0483c-6815-4797-8ace-5a852ae16c09 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.206224 Oct 04 09:01:11.907157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 537/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:11 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:12.930611 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:12.931517 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:12.938303 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:12.939114 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:12.944946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:12.944946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:12.944946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:12.944946 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:13.086986 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:13.096782 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-69260949-4d43-4494-8d30-8a33a5aabd4d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.170026 Oct 04 09:01:13.097355 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 530/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:12 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:14.121032 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:14.121742 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:14.129614 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:14.129779 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:14.130117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:14.130851 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:14.131310 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:14.131738 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:14.283862 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:14.292009 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f4cf3d0a-4de6-4674-ac68-ba98153d7f91 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.174778 Oct 04 09:01:14.292575 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 538/1068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:14 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:15.316843 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:15.317467 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:15.324335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:15.325010 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:15.326476 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:15.327176 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:15.327630 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:15.328203 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:15.480390 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:15.489646 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bafb888e-e9dd-44e3-a7e1-d9854cc46245 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.176905 Oct 04 09:01:15.490233 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 531/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:15 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:16.514938 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:16.515552 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:16.521939 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:16.522431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:16.522884 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:16.523566 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:16.524180 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:16.524524 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:16.665846 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:16.675548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6b684407-a863-43e2-89c1-cda3cc6f7aea tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.164897 Oct 04 09:01:16.676121 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 539/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:16 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:17.699726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:17.700377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:17.703039 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=4 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:17.708016 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:17.708501 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:17.708934 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:17.709628 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:17.710147 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:17.710544 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:17.845158 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:17.853115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-84347786-70cd-4a39-9451-879fa17ca0f9 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.157301 Oct 04 09:01:17.854717 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 532/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:17 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:18.877537 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:18.878162 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:18.884741 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:18.885229 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:18.885691 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:18.886390 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:18.886879 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:18.887305 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:19.031166 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:19.031166 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-51af2513-3882-4b42-9d95-e5c8f20d8358 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.155296 Oct 04 09:01:19.031166 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 540/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:18 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:20.055378 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:20.055997 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:20.062632 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:20.063124 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:20.063561 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:20.064256 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:20.064710 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:20.065135 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:20.213388 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:20.222474 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9b639ad5-44c6-46e3-998b-7d67a1eb81a4 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.171765 Oct 04 09:01:20.233294 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 533/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:20 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:21.249094 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:21.249711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:21.256083 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:21.256570 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:21.257011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:21.257711 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:21.258165 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:21.258626 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:21.403373 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:21.412605 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-73250128-0682-40ae-b812-7ae0922aa5d8 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.168341 Oct 04 09:01:21.413443 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 541/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:21 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:22.437631 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:22.438312 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:22.445536 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:22.446015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:22.446520 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:22.447215 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:22.447669 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:22.448095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:22.600577 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:22.609331 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e3c1d907-7a01-42d5-b5ab-b3e5b8a12f6c tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.175700 Oct 04 09:01:22.609904 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 534/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:22 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:23.632725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:23.633341 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:23.640502 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:23.640999 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:23.641434 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:23.642124 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:23.642598 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:23.643021 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:23.775145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:23.785169 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-2e9aad34-5438-4eef-909c-4df2af2c23f7 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.156215 Oct 04 09:01:23.785732 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 542/1076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:23 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:24.808078 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:24.808695 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:24.820289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:24.820289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:24.820289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:24.820289 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:24.828960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:24.828960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:24.959158 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:24.966893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-10c86971-01fe-4509-abd2-fb1cd83b3b8e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.162677 Oct 04 09:01:24.968074 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 535/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:24 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:25.255733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-9498feb5-9da7-4ea0-bedd-10b982fbdd5c req-6447c0c0-a9e0-416e-8572-eba530e79017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da2fd17-4355-438b-a667-e7881a655fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "fea14249-82d5-4c27-9abc-925c8ffa80c5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:25.266608 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9498feb5-9da7-4ea0-bedd-10b982fbdd5c req-6447c0c0-a9e0-416e-8572-eba530e79017 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:25.267091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9498feb5-9da7-4ea0-bedd-10b982fbdd5c req-6447c0c0-a9e0-416e-8572-eba530e79017 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:25.267552 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-9498feb5-9da7-4ea0-bedd-10b982fbdd5c req-6447c0c0-a9e0-416e-8572-eba530e79017 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:25.279142 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-9498feb5-9da7-4ea0-bedd-10b982fbdd5c req-6447c0c0-a9e0-416e-8572-eba530e79017 service nova] Creating event network-vif-unplugged:fea14249-82d5-4c27-9abc-925c8ffa80c5 for instance 0da2fd17-4355-438b-a667-e7881a655fe2 on hv-cinder-85944 Oct 04 09:01:25.284891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-9498feb5-9da7-4ea0-bedd-10b982fbdd5c req-6447c0c0-a9e0-416e-8572-eba530e79017 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032893 Oct 04 09:01:25.285571 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 543/1078] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:25.991693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:25.992459 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:25.994814 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:26.001950 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:26.002493 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:26.002933 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:26.003648 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:26.004086 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:26.004510 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:26.182188 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:26.191891 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b7580db5-b0d4-4b9a-8c6c-2161f869a857 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.204084 Oct 04 09:01:26.205017 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 536/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:25 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:27.217726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:27.218476 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:27.227397 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.227397 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.227397 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.227397 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.227772 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.227772 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.369736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:27.384261 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c22b513d-0654-495e-8a3e-e01120c589eb tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1510 microversion: 2.1 time: 0.171291 Oct 04 09:01:27.384844 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 544/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:27 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:27.408610 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:27.409212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:27.416144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.416675 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.417118 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.417810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.418271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.418732 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.421091 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:27.449637 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127549) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 09:01:27.742999 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-79dfe2c2-9abc-490a-8d7d-c61798bb11dd tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "POST /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2/action" status: 202 len: 0 microversion: 2.1 time: 0.338626 Oct 04 09:01:27.743608 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 537/1081] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Oct 4 09:01:27 2022] POST /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:01:27.758312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:27.759001 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:27.770793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.770793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.770793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.770793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:27.771133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:27.771133 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:27.921380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:27.924281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=98 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:27.934300 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-7fa00e60-f5b2-4dda-bb1e-b0c5f3603272 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1518 microversion: 2.1 time: 0.184926 Oct 04 09:01:27.935900 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 545/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:27 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:28.960206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:28.960827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:28.968936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:28.968936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:28.968936 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:28.969910 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:28.970215 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:28.970940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:29.119153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:29.132501 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-16ad3034-1fe6-4a26-9821-10c2bbf7079a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1518 microversion: 2.1 time: 0.176494 Oct 04 09:01:29.147212 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 538/1083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:28 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:30.167901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:30.168584 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:30.170872 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=36 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:30.176525 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:30.177013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:30.177447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:30.178157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:30.180375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:30.180375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:30.333611 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:30.342196 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-da8fd628-bbc6-4451-ae25-9367577f6774 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1520 microversion: 2.1 time: 0.178868 Oct 04 09:01:30.342892 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 546/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:30 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:31.367350 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:31.368807 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:31.376009 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.376818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.377459 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.378342 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:31.379006 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:31.379761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:31.554159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:31.566550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-1f058ec3-9bc8-456f-a74f-57351af22e3b tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.202055 Oct 04 09:01:31.566550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 539/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:31 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:32.589970 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:32.590615 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:32.597404 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:32.597897 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:32.598333 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:32.599055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:32.599501 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:32.600108 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:32.769809 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:32.777414 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c68bb980-c1f2-4c1a-8510-393730364640 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.191924 Oct 04 09:01:32.777980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 547/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:32 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:33.737550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-787824350", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-850828242", "security_groups": [{"name": "tempest-secgroup-smoke-901326654"}], "block_device_mapping_v2": [{"uuid": "c9da9063-5c26-44a2-a8f5-40a97b0c5f27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a74c7fc7-ef7f-4524-af4b-bb7156e889af"}]}} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:33.801999 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:33.803551 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:33.808607 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:33.809089 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:33.809517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:33.810201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:33.810684 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:33.811108 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:33.942288 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:33.950156 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0823aff4-d3ac-4182-ab23-6f1cb8852907 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.152857 Oct 04 09:01:33.950974 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 548/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:33 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:01:34.123252 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.network.neutron [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] validate_networks() for [('a74c7fc7-ef7f-4524-af4b-bb7156e889af', None, None, None, None, None)] {{(pid=127549) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:01:34.511198 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Flavor limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:01:34.511625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Image limits 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:01:34.512144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Flavor pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:01:34.512558 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Image pref 0:0:0 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:01:34.512967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.virt.hardware [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127549) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:01:34.522540 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.523022 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.523477 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.524202 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.524652 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.525074 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.541141 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Getting quotas for project 07b9220d86234adc83ef7fbe0d4d834d. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:01:34.545045 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.quota [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Getting quotas for user 471299b556bd4c22b51defc14b49d8eb and project 07b9220d86234adc83ef7fbe0d4d834d. Resources: {'ram', 'cores', 'instances'} {{(pid=127549) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:01:34.604894 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Going to run 1 instances... {{(pid=127549) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:01:34.605740 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c9da9063-5c26-44a2-a8f5-40a97b0c5f27',volume_size=None,volume_type=None)] {{(pid=127549) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:01:34.974507 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:34.975119 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:34.981416 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.981919 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.982336 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:34.983051 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:34.983510 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:34.983934 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:35.036808 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-c695ee28-6605-4b60-9b2b-1445afb134af tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.303669 Oct 04 09:01:35.037687 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 540/1088] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 09:01:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:01:35.048951 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bf663a1d-5993-417d-9a84-f45ba2569509 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:35.049564 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bf663a1d-5993-417d-9a84-f45ba2569509 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:35.117290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-bf663a1d-5993-417d-9a84-f45ba2569509 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:35.127132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bf663a1d-5993-417d-9a84-f45ba2569509 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1093 microversion: 2.1 time: 0.082461 Oct 04 09:01:35.138591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 541/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:35 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:01:35.153506 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:35.162992 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6468ed49-1c30-4efb-924a-5606c86f2b01 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.192192 Oct 04 09:01:35.163822 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 549/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:34 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:01:36.151365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:36.152072 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:36.161640 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:36.162211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:36.162679 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:36.163376 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:36.163827 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:36.164251 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:36.187644 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:36.189513 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:36.195978 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:36.196468 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:36.196911 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:36.197607 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:36.198066 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:36.198517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:36.225153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:36.233413 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8ad38c33-f723-434a-be6c-42215b17de48 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1143 microversion: 2.1 time: 0.085803 Oct 04 09:01:36.233993 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 542/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:36 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:36.346977 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:36.354668 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4ed00872-e559-4e08-a0e8-e22efe462a35 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.170882 Oct 04 09:01:36.355224 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 550/1092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:36 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:01:37.258989 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:37.259606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:37.266383 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:37.267741 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:37.268657 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:37.269371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:37.269837 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:37.270288 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:37.336372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:37.344404 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-263c0ca9-06e8-477d-816e-23c45c5ae27f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1191 microversion: 2.1 time: 0.089185 Oct 04 09:01:37.344969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 543/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:37 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:37.379561 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:37.380189 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:37.387328 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:37.387902 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:37.388382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:37.389074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:37.389588 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:37.390303 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:37.520145 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:37.527789 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-099c99f3-4e93-499f-967d-f1d3dba4d028 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.153377 Oct 04 09:01:37.528344 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 551/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:37 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:38.367771 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:38.368400 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:38.375265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:38.376107 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:38.376754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:38.377925 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:38.378756 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:38.379346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:38.448931 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:38.457499 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-04740b1c-1d56-4292-8a90-194eede20c2a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1209 microversion: 2.1 time: 0.093956 Oct 04 09:01:38.458062 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 544/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:38 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:38.552239 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:38.552851 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:38.559187 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:38.559670 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:38.560112 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:38.560913 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:38.561371 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:38.561791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:38.779729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:38.791987 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-0e6c8668-c893-4ccd-8700-b3e24b34cd69 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.244702 Oct 04 09:01:38.792567 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 552/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:38 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:39.489787 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:39.491146 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:39.500803 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.502191 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.502955 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.503643 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.504273 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.506186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.653719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:39.663553 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e5198957-9266-431e-bd19-e306d29cab54 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1276 microversion: 2.1 time: 0.178055 Oct 04 09:01:39.664554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 545/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:39 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:39.726421 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-b32f6994-47df-4603-ac00-ab1897d7955d req-613e3e10-981e-4a7c-9fa2-fb45775f786a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710ef0a9-6fc5-4e69-9e08-aef2fe6f3944", "tag": "006528db-78e7-44bd-b275-a6a647754ae9"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:39.736888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b32f6994-47df-4603-ac00-ab1897d7955d req-613e3e10-981e-4a7c-9fa2-fb45775f786a service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.738025 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b32f6994-47df-4603-ac00-ab1897d7955d req-613e3e10-981e-4a7c-9fa2-fb45775f786a service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.738025 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-b32f6994-47df-4603-ac00-ab1897d7955d req-613e3e10-981e-4a7c-9fa2-fb45775f786a service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.749696 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-b32f6994-47df-4603-ac00-ab1897d7955d req-613e3e10-981e-4a7c-9fa2-fb45775f786a service nova] Creating event network-changed:006528db-78e7-44bd-b275-a6a647754ae9 for instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 on hv-cinder-85944 Oct 04 09:01:39.756157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-b32f6994-47df-4603-ac00-ab1897d7955d req-613e3e10-981e-4a7c-9fa2-fb45775f786a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033231 Oct 04 09:01:39.756768 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 553/1098] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:39.817769 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:39.817769 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:39.827700 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.828347 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.829045 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.829993 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:39.830670 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:39.832181 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:39.996060 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:40.006176 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0044803d-edb7-492c-80d7-89247d8a5b2f tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.192798 Oct 04 09:01:40.019037 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 546/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:39 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:40.691476 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:40.692183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:40.721258 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:40.721258 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:40.721258 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:40.721258 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:40.721610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:40.721610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:40.868375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:40.876239 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-6ef7cfea-c58c-4266-8803-ad7a71a6e468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.188961 Oct 04 09:01:40.880641 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 554/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:40 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:41.034165 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:41.036499 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:41.048840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:41.049720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:41.050545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:41.051845 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:41.052671 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:41.053446 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:41.223310 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:41.231377 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-39207144-f6b7-4981-978d-b453875e1453 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.205657 Oct 04 09:01:41.231956 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 547/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:41 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:41.899537 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:41.900151 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:41.906682 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:41.907168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:41.907646 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:41.908363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:41.908814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:41.909235 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:42.040476 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:42.048845 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-eee123e2-29df-413e-b3e9-7ae9e3e16a92 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.152619 Oct 04 09:01:42.049921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 555/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:41 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:42.261247 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:42.261872 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:42.268918 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:42.269416 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:42.269853 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:42.270598 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:42.271055 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:42.271484 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:42.409961 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:42.417859 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-0cd53daf-346d-4e20-8eb6-0251ec0f040e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.160472 Oct 04 09:01:42.418448 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 548/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:42 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:43.072994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:43.073821 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:43.080870 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:43.081417 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:43.081852 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:43.082574 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:43.083031 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:43.083451 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:43.225649 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:43.233724 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b29470a7-6f0e-4bb2-9b8e-7fead5d1342f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.164539 Oct 04 09:01:43.234307 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 556/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:43 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:43.441958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:43.442600 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:43.448941 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:43.449428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:43.449841 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:43.450546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:43.450997 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:43.451408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:43.580368 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:43.588594 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a16dbe1d-5ace-4000-a27d-f344525e6f7d tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.151270 Oct 04 09:01:43.589169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 549/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:43 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:44.156842 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-490a2910-988c-4a83-9f6f-3e38f5e56da2 req-a5641f57-3261-4d62-bb76-c1d56197f889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da2fd17-4355-438b-a667-e7881a655fe2", "name": "network-vif-plugged", "status": "completed", "tag": "fea14249-82d5-4c27-9abc-925c8ffa80c5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:44.167581 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-490a2910-988c-4a83-9f6f-3e38f5e56da2 req-a5641f57-3261-4d62-bb76-c1d56197f889 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.168056 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-490a2910-988c-4a83-9f6f-3e38f5e56da2 req-a5641f57-3261-4d62-bb76-c1d56197f889 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.168484 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-490a2910-988c-4a83-9f6f-3e38f5e56da2 req-a5641f57-3261-4d62-bb76-c1d56197f889 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:44.182176 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-490a2910-988c-4a83-9f6f-3e38f5e56da2 req-a5641f57-3261-4d62-bb76-c1d56197f889 service nova] Creating event network-vif-plugged:fea14249-82d5-4c27-9abc-925c8ffa80c5 for instance 0da2fd17-4355-438b-a667-e7881a655fe2 on hv-cinder-85944 Oct 04 09:01:44.185674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-490a2910-988c-4a83-9f6f-3e38f5e56da2 req-a5641f57-3261-4d62-bb76-c1d56197f889 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032893 Oct 04 09:01:44.186240 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 557/1106] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:44.258075 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:44.258720 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:44.267980 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.267980 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.271953 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:44.271953 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.271953 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.271953 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:44.417318 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:44.426121 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-aaa436bf-a350-41f8-a952-e0230f3961bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.172084 Oct 04 09:01:44.426846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 550/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:44 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:44.612648 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:44.613363 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:44.619766 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.620281 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.620724 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:44.621406 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:44.621859 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:44.622531 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:44.755358 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:44.763496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-955c4e74-7da1-4b75-a126-c0e9c8750d61 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1576 microversion: 2.1 time: 0.155875 Oct 04 09:01:44.764071 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 558/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:44 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:45.455958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:45.456597 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:45.458988 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:45.459691 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=8 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:45.465527 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:45.471365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:45.471365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:45.471365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:45.471365 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:45.471725 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:45.606281 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:45.615797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2d0502ec-a77a-427e-8b74-5cba21bbea22 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.168785 Oct 04 09:01:45.616372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 551/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:45 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:45.788935 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:45.789431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:45.795817 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:45.796297 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:45.796734 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:45.797540 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:45.797894 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:45.798362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:45.936176 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:45.944002 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f36ce86b-c634-4a85-8e8b-2f07adc6c005 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1563 microversion: 2.1 time: 0.159553 Oct 04 09:01:45.944568 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 559/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:45 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:46.640494 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:46.641119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:46.648343 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:46.648821 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:46.649253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:46.649940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:46.650389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:46.650832 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:46.777081 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:46.785654 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-419132fc-6e0a-4bce-a3da-97a21b5ba24f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.149908 Oct 04 09:01:46.786211 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 552/1111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:46 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:47.808661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:47.809313 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:47.816256 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:47.816774 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:47.817213 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:47.822106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:47.822106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:47.822106 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:47.959731 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:47.967431 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e12d53cc-12b2-49e4-9c2f-526fc2cb7b9c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.162661 Oct 04 09:01:47.967992 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 560/1112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:47 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:48.990073 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:48.990726 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:48.997447 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:48.998609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:48.998609 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:48.999177 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:48.999640 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:49.000071 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:49.170576 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:49.178945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-9a55d575-2ed5-442f-b040-f3bca24bc8bf tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.192953 Oct 04 09:01:49.179934 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 553/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:48 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:50.203572 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:50.210377 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:50.211655 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:50.212356 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:50.212803 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:50.213503 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:50.213958 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:50.214382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:50.237550 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-390baae3-d05c-4606-bc5b-4d48c118cf96 req-b898010b-fcff-4665-bbfb-2cc431a2e14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710ef0a9-6fc5-4e69-9e08-aef2fe6f3944", "name": "network-vif-plugged", "status": "completed", "tag": "006528db-78e7-44bd-b275-a6a647754ae9"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:50.257975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-390baae3-d05c-4606-bc5b-4d48c118cf96 req-b898010b-fcff-4665-bbfb-2cc431a2e14e service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:50.258500 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-390baae3-d05c-4606-bc5b-4d48c118cf96 req-b898010b-fcff-4665-bbfb-2cc431a2e14e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:50.258919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-390baae3-d05c-4606-bc5b-4d48c118cf96 req-b898010b-fcff-4665-bbfb-2cc431a2e14e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:50.271503 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-390baae3-d05c-4606-bc5b-4d48c118cf96 req-b898010b-fcff-4665-bbfb-2cc431a2e14e service nova] Creating event network-vif-plugged:006528db-78e7-44bd-b275-a6a647754ae9 for instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 on hv-cinder-85944 Oct 04 09:01:50.276854 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-390baae3-d05c-4606-bc5b-4d48c118cf96 req-b898010b-fcff-4665-bbfb-2cc431a2e14e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043616 Oct 04 09:01:50.278568 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 554/1114] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:01:50.425475 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:50.433632 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-47d6b3e4-b943-4b8b-a771-9648fd351757 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.234737 Oct 04 09:01:50.434677 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 561/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:50 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:51.458028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:51.459008 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:51.465557 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:51.466040 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:51.466497 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:51.467192 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:51.467641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:51.468088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:51.470847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:51.619031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:51.628083 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8ba5d7fb-6ba6-42cc-aba9-6ef76ac5e013 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1264 microversion: 2.1 time: 0.174783 Oct 04 09:01:51.628657 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 555/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:51 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:52.651317 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:52.652068 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:52.659438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.659917 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.660423 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.661042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.661492 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.661912 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.803729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:52.811439 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-08675065-119c-4035-a0aa-8babddcc5117 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1452 microversion: 2.1 time: 0.163956 Oct 04 09:01:52.812003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 562/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:52 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:52.835283 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:01:52.841372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:01:52.842182 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.842992 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.843429 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.844137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:52.844588 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:52.845011 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:52.981895 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:01:52.990484 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-868a9e9a-3944-437e-af22-64610ba66fce tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1452 microversion: 2.1 time: 0.160191 Oct 04 09:01:52.991268 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 556/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:01:52 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:01:55.530343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-0bc1872c-2697-454a-bc42-95b93eafc8b9 req-580d9093-ea3c-4dfe-9ca8-8da62bd2430e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710ef0a9-6fc5-4e69-9e08-aef2fe6f3944", "tag": "006528db-78e7-44bd-b275-a6a647754ae9"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:01:55.540525 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-0bc1872c-2697-454a-bc42-95b93eafc8b9 req-580d9093-ea3c-4dfe-9ca8-8da62bd2430e service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:01:55.541115 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-0bc1872c-2697-454a-bc42-95b93eafc8b9 req-580d9093-ea3c-4dfe-9ca8-8da62bd2430e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:01:55.541636 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-0bc1872c-2697-454a-bc42-95b93eafc8b9 req-580d9093-ea3c-4dfe-9ca8-8da62bd2430e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:01:55.559933 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-0bc1872c-2697-454a-bc42-95b93eafc8b9 req-580d9093-ea3c-4dfe-9ca8-8da62bd2430e service nova] Creating event network-changed:006528db-78e7-44bd-b275-a6a647754ae9 for instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 on hv-cinder-85944 Oct 04 09:01:55.565398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-0bc1872c-2697-454a-bc42-95b93eafc8b9 req-580d9093-ea3c-4dfe-9ca8-8da62bd2430e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171932 Oct 04 09:01:55.566314 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 563/1119] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:05.477612 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:05.478151 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:05.478661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=35 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:05.479470 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=97 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:05.480727 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:03:05.480861 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Tue Oct 4 09:03:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 04 09:03:05.481987 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:05.483049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=11 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:05.488267 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:05.489026 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:05.489541 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:05.490342 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:05.490997 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:05.491426 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:05.518882 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:03:05.618927 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-65d7d90a-1c11-4c8a-b35b-4d41fbe6865a req-8d6cc8a8-1759-4e4e-9f5d-fe09deba86c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da2fd17-4355-438b-a667-e7881a655fe2", "tag": "fea14249-82d5-4c27-9abc-925c8ffa80c5"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:05.628903 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-65d7d90a-1c11-4c8a-b35b-4d41fbe6865a req-8d6cc8a8-1759-4e4e-9f5d-fe09deba86c2 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:05.629377 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-65d7d90a-1c11-4c8a-b35b-4d41fbe6865a req-8d6cc8a8-1759-4e4e-9f5d-fe09deba86c2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:05.629811 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-65d7d90a-1c11-4c8a-b35b-4d41fbe6865a req-8d6cc8a8-1759-4e4e-9f5d-fe09deba86c2 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:05.642234 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-65d7d90a-1c11-4c8a-b35b-4d41fbe6865a req-8d6cc8a8-1759-4e4e-9f5d-fe09deba86c2 service nova] Creating event network-changed:fea14249-82d5-4c27-9abc-925c8ffa80c5 for instance 0da2fd17-4355-438b-a667-e7881a655fe2 on hv-cinder-85944 Oct 04 09:03:05.647986 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-65d7d90a-1c11-4c8a-b35b-4d41fbe6865a req-8d6cc8a8-1759-4e4e-9f5d-fe09deba86c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171355 Oct 04 09:03:05.652392 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 564/1120] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:03:05.887686 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-196fee4a-a230-4069-833b-c502b6ec364e tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 204 len: 0 microversion: 2.1 time: 0.414279 Oct 04 09:03:05.888504 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 557/1121] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 09:03:05 2022] DELETE /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:03:05.897563 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:05.899139 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:05.905589 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:05.906136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:05.906629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:05.907334 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:05.907839 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:05.908611 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:06.101463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:06.110030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-414e1671-9e0d-46c7-af91-93a27e882cd3 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.216889 Oct 04 09:03:06.110621 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 565/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:05 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:07.133670 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:07.134445 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:07.142259 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:07.142770 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:07.143235 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:07.143927 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:07.144379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:07.144801 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:07.323238 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:07.331670 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-59404703-6892-40fc-848b-c3f81488a8e1 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1569 microversion: 2.1 time: 0.202259 Oct 04 09:03:07.332253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 558/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:07 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:08.356136 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:08.356577 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:08.359502 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb06a5f2-5c51-452f-9177-ca8dc02ec9f9] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 09:03:08.364054 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:08.364669 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:08.365183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:08.365885 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:08.366338 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:08.366795 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:08.522081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:08.522081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-99e96e2c-0049-4b1e-b7c5-ec49eb00156a tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1450 microversion: 2.1 time: 0.168540 Oct 04 09:03:08.522081 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 566/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:08 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:08.559666 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-fd26df3e-7656-4c18-8695-abcd85140549 req-1e29d055-e6d3-49f6-94ba-6df4a37832b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da2fd17-4355-438b-a667-e7881a655fe2", "name": "network-vif-deleted", "tag": "fea14249-82d5-4c27-9abc-925c8ffa80c5"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:08.569625 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-fd26df3e-7656-4c18-8695-abcd85140549 req-1e29d055-e6d3-49f6-94ba-6df4a37832b1 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:08.570031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-fd26df3e-7656-4c18-8695-abcd85140549 req-1e29d055-e6d3-49f6-94ba-6df4a37832b1 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:08.570492 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-fd26df3e-7656-4c18-8695-abcd85140549 req-1e29d055-e6d3-49f6-94ba-6df4a37832b1 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:08.582166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-fd26df3e-7656-4c18-8695-abcd85140549 req-1e29d055-e6d3-49f6-94ba-6df4a37832b1 service nova] Creating event network-vif-deleted:fea14249-82d5-4c27-9abc-925c8ffa80c5 for instance 0da2fd17-4355-438b-a667-e7881a655fe2 on hv-cinder-85944 Oct 04 09:03:08.587440 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-fd26df3e-7656-4c18-8695-abcd85140549 req-1e29d055-e6d3-49f6-94ba-6df4a37832b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031370 Oct 04 09:03:08.587958 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 559/1125] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:09.544064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:09.544687 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:09.552093 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:09.552585 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:09.553024 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:09.553801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:09.554259 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:09.554727 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:09.571748 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb06a5f2-5c51-452f-9177-ca8dc02ec9f9] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42608. Oct 04 09:03:09.587516 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:09.587995 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:09.588424 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:09.588866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lazy-loading 'fault' on Instance uuid 0da2fd17-4355-438b-a667-e7881a655fe2 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:03:09.631195 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa4a1f5f6954d92830b7df74952161e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655f83bbd3d847f3b060af2ff5250585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:09.639410 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a79846d3-e234-41e0-ab49-47e1097158b6 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 200 len: 1224 microversion: 2.1 time: 0.099657 Oct 04 09:03:09.644375 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 567/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:09 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:10.663314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:10.663948 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] [instance: 0da2fd17-4355-438b-a667-e7881a655fe2] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:10.670186 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:10.670693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:10.671132 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:10.671821 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:10.672278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:10.672721 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:10.686532 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] HTTP exception thrown: Instance 0da2fd17-4355-438b-a667-e7881a655fe2 could not be found. Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Request method failure captured: Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 HTTP/1.1 Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_WLzbDQN1vMNLSuX-TdgdOUyxuAio9GZ3Ztg_J3lOZ1jQylr2fDxTmJhE39xrZj4pSkMAkAs8aiS50x9dUxdg6vZbLl2lcPGg2UJ2Pr6IWUrA0II78oemJ_IHP8_chwq_4m9YcHMtFWuZYnd-YeK4KVWTDJysJUhRuWEPyGybK9-u4 Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 655f83bbd3d847f3b060af2ff5250585 Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-TestShelveInstance-1960734961 Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 09:03:10.688153 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/655f83bbd3d847f3b060af2ff5250585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/655f83bbd3d847f3b060af2ff5250585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_655f83bbd3d847f3b060af2ff5250585", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/655f83bbd3d847f3b060af2ff5250585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-TestShelveInstance-1960734961 Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 655f83bbd3d847f3b060af2ff5250585 Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-TestShelveInstance-1960734961 Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-TestShelveInstance-1960734961-project Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: faa4a1f5f6954d92830b7df74952161e Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-TestShelveInstance-1960734961-project Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 0da2fd17-4355-438b-a667-e7881a655fe2 could not be found. Oct 04 09:03:10.689973 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '0da2fd17-4355-438b-a667-e7881a655fe2'} Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da2fd17-4355-438b-a667-e7881a655fe2 could not be found. Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:10.691032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da2fd17-4355-438b-a667-e7881a655fe2 could not be found. Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da2fd17-4355-438b-a667-e7881a655fe2 could not be found. Oct 04 09:03:10.692699 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:10.694314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Returning 404 to user: Instance 0da2fd17-4355-438b-a667-e7881a655fe2 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:10.694314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-74414189-f625-49cc-b04e-d86a3bbe8c43 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2" status: 404 len: 111 microversion: 2.1 time: 0.031153 Oct 04 09:03:10.694314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 560/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:10 2022] GET /compute/v2.1/servers/0da2fd17-4355-438b-a667-e7881a655fe2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:03:10.922547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-65ffdb6e-1ca2-412c-a207-cb224e81bc04 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] Calling method '.version_select at 0x7f6f1a637040>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:11.025658 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-65ffdb6e-1ca2-412c-a207-cb224e81bc04 tempest-TestShelveInstance-1960734961 tempest-TestShelveInstance-1960734961-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-868131196" status: 202 len: 0 microversion: 2.1 time: 0.106940 Oct 04 09:03:11.026241 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 568/1128] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Oct 4 09:03:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-868131196 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 09:03:52.545649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:52.546243 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:52.548360 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:52.549141 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:52.553622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:52.554102 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:52.554565 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:52.555292 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:52.555746 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:52.556169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:52.582355 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:03:52.899671 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bc958175-32b7-4b65-a294-163883141ea4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "DELETE /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 204 len: 0 microversion: 2.1 time: 0.357486 Oct 04 09:03:52.900338 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 561/1129] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 09:03:52 2022] DELETE /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:03:52.909674 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=22 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:52.910430 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:52.914759 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:52.915377 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:52.923005 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:52.923523 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:52.923940 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:52.924635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:52.925091 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:52.925542 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:53.075679 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:53.086908 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-50e4641d-184c-4ad1-b2fd-57558c1da07c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1577 microversion: 2.1 time: 0.178527 Oct 04 09:03:53.087480 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 569/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:52 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:54.120577 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:54.121277 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:54.127706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:54.128196 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:54.128640 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:54.129333 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:54.129790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:54.130221 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:54.263914 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:54.271846 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-50d95e43-5ea3-4930-8645-eae000650763 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1577 microversion: 2.1 time: 0.155555 Oct 04 09:03:54.272412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 562/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:54 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:55.254177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-c333d56d-6420-44c8-9a69-c48626763a9a req-792e5165-50bb-4fa6-a865-bae5776b77fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710ef0a9-6fc5-4e69-9e08-aef2fe6f3944", "name": "network-vif-deleted", "tag": "006528db-78e7-44bd-b275-a6a647754ae9"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:55.270493 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-c333d56d-6420-44c8-9a69-c48626763a9a req-792e5165-50bb-4fa6-a865-bae5776b77fb service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:55.270982 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-c333d56d-6420-44c8-9a69-c48626763a9a req-792e5165-50bb-4fa6-a865-bae5776b77fb service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:55.271419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-c333d56d-6420-44c8-9a69-c48626763a9a req-792e5165-50bb-4fa6-a865-bae5776b77fb service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:55.283223 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-c333d56d-6420-44c8-9a69-c48626763a9a req-792e5165-50bb-4fa6-a865-bae5776b77fb service nova] Creating event network-vif-deleted:006528db-78e7-44bd-b275-a6a647754ae9 for instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 on hv-cinder-85944 Oct 04 09:03:55.288221 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-c333d56d-6420-44c8-9a69-c48626763a9a req-792e5165-50bb-4fa6-a865-bae5776b77fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037740 Oct 04 09:03:55.288814 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 570/1132] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:03:55.296516 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:55.298015 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:55.309462 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:55.309940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:55.311063 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:55.314095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:55.314095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:55.314095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:55.386188 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:55.397358 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-267d8854-d6e3-4946-9cfa-887a6dd55c9d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1510 microversion: 2.1 time: 0.104749 Oct 04 09:03:55.398389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 563/1133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:55 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1510 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:56.421112 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:56.421882 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:56.428040 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:56.428525 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:56.428966 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:56.429689 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:56.430119 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:56.430578 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:56.464419 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:56.464903 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:56.465342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:56.465787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lazy-loading 'fault' on Instance uuid 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:03:56.507817 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:56.515661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-bef8a6c3-5ee4-4823-9d19-c542f664b665 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 200 len: 1183 microversion: 2.1 time: 0.099223 Oct 04 09:03:56.516816 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 571/1134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:56 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 1183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:57.539386 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:57.540108 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:57.546819 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:57.547379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:57.547886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:57.548641 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:57.549159 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:57.549667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:57.563869 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] HTTP exception thrown: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Request method failure captured: Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 HTTP/1.1 Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_ZKdBHVlzvS_rk8n0iIGiFzMrbix4Aafy5xuDxpbhb7oxf9D9p2AyJSDwFtGYmyqJBKPHw9WWSt3caf79JT0QZSPf6gJ_Ssy2z4utZl29EIof42YTnoIa2PLqP-FexAYNC5E0JrkwUJnkbLPpURGoCHHEE-u0Wld-2pZflCdaKdzxk Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 09:03:57.565667 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07b9220d86234adc83ef7fbe0d4d834d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-TestVolumeBootPattern-205612545 Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 471299b556bd4c22b51defc14b49d8eb Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:03:57.567271 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '710ef0a9-6fc5-4e69-9e08-aef2fe6f3944'} Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:03:57.568166 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:03:57.569644 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:03:57.570969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Returning 404 to user: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:03:57.570969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-fb0f0f04-4c3d-4049-86ba-88d00a0006b8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 404 len: 111 microversion: 2.1 time: 0.031621 Oct 04 09:03:57.570969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 564/1135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:57 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:03:57.665450 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-758063991", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-850828242", "security_groups": [{"name": "tempest-secgroup-smoke-901326654"}], "block_device_mapping_v2": [{"uuid": "c9da9063-5c26-44a2-a8f5-40a97b0c5f27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a74c7fc7-ef7f-4524-af4b-bb7156e889af"}]}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:03:57.778135 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] validate_networks() for [('a74c7fc7-ef7f-4524-af4b-bb7156e889af', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:03:58.249544 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:03:58.249964 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:03:58.250473 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:03:58.256624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:03:58.256624 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:03:58.259994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:58.260476 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:58.260921 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:58.261643 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:58.262095 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:58.262546 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:58.280251 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Getting quotas for project 07b9220d86234adc83ef7fbe0d4d834d. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:03:58.284296 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Getting quotas for user 471299b556bd4c22b51defc14b49d8eb and project 07b9220d86234adc83ef7fbe0d4d834d. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:03:58.340309 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:03:58.342535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c9da9063-5c26-44a2-a8f5-40a97b0c5f27',volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:03:58.782627 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3c5e2fa0-b09a-42e7-81bb-7e8bc121e3bd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.120882 Oct 04 09:03:58.788299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 572/1136] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 09:03:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:03:58.794253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f63baad3-8c45-469f-bb05-d1996bc5435e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:58.795868 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f63baad3-8c45-469f-bb05-d1996bc5435e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:58.849500 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f63baad3-8c45-469f-bb05-d1996bc5435e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:58.856401 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f63baad3-8c45-469f-bb05-d1996bc5435e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1093 microversion: 2.1 time: 0.065948 Oct 04 09:03:58.857521 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 565/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:58 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:03:59.879550 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:03:59.880248 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:03:59.886247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:59.886769 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:59.887211 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:59.887898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:03:59.889065 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:03:59.889503 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:03:59.959443 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:03:59.968041 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-368bdfb4-be57-4a0f-a5a1-26dc8989da82 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1143 microversion: 2.1 time: 0.092891 Oct 04 09:03:59.968617 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 573/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:03:59 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:00.991270 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:00.991878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:01.000300 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:01.000919 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:01.001426 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:01.002126 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:01.002607 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:01.003029 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:01.065168 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:01.073076 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-15650062-61ea-43a5-911a-4e3ee1c757ee tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1209 microversion: 2.1 time: 0.085752 Oct 04 09:04:01.073647 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 566/1139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:00 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:02.096349 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:02.097057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:02.103426 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:02.103910 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:02.104342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:02.105028 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:02.105477 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:02.105901 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:02.241801 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:02.250202 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-3c439fb1-0091-430f-8e20-47daaeae99f5 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.158109 Oct 04 09:04:02.251015 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 574/1140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:02 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:02.451208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-f31f0de8-95a1-484e-9847-49e60327bf04 req-cbe19cef-0b4c-43b4-b941-0fb414af243e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a37cf74c-826b-45a7-b571-2dc3e1cf3e7c", "tag": "4db9d8fe-2df7-4990-8b7d-450dd46d8043"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:02.462718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-f31f0de8-95a1-484e-9847-49e60327bf04 req-cbe19cef-0b4c-43b4-b941-0fb414af243e service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:02.463206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-f31f0de8-95a1-484e-9847-49e60327bf04 req-cbe19cef-0b4c-43b4-b941-0fb414af243e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:02.463633 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-f31f0de8-95a1-484e-9847-49e60327bf04 req-cbe19cef-0b4c-43b4-b941-0fb414af243e service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:02.475457 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-f31f0de8-95a1-484e-9847-49e60327bf04 req-cbe19cef-0b4c-43b4-b941-0fb414af243e service nova] Creating event network-changed:4db9d8fe-2df7-4990-8b7d-450dd46d8043 for instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c on hv-cinder-85944 Oct 04 09:04:02.480058 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-f31f0de8-95a1-484e-9847-49e60327bf04 req-cbe19cef-0b4c-43b4-b941-0fb414af243e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032642 Oct 04 09:04:02.480643 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 567/1141] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:03.281184 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:03.281791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:03.288101 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:03.288583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:03.289013 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:03.289696 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:03.290146 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:03.290594 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:03.421928 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:03.429667 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9629287f-aa30-47cb-bbde-16e5a3ef240a tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.152395 Oct 04 09:04:03.430233 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 575/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:03 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:04.454112 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:04.454839 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:04.460893 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:04.461371 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:04.461804 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:04.462512 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:04.462967 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:04.463389 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:04.592088 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:04.599747 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-bf864dfc-4657-4709-9d80-b4ee0bbab249 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.150945 Oct 04 09:04:04.600301 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 568/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:04 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:05.621097 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:05.621700 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:05.628057 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:05.628535 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:05.628970 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:05.629654 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:05.630104 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:05.630547 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:05.762428 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:05.770898 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-309b5133-6c99-4781-a761-74e8666a5511 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.153647 Oct 04 09:04:05.771452 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 576/1144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:05 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:06.794054 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:06.795500 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:06.802021 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:06.803119 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:06.803562 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:06.804265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:06.804722 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:06.805340 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:06.938267 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:06.946243 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-92c8f2da-2188-463d-a1cf-b16f1d6cc22b tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.156844 Oct 04 09:04:06.946838 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 569/1145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:06 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:07.969545 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:07.970147 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:07.976635 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:07.977116 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:07.977554 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:07.978246 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:07.978736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:07.979161 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:08.117794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:08.126159 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-5372c365-0ae0-4e06-ae6b-5a2290f9b7f8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.160491 Oct 04 09:04:08.126751 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 577/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:07 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:09.149229 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:09.149842 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:09.152363 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:09.157138 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:09.160858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:09.160858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:09.160858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:09.160858 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:09.161272 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:09.288922 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:09.296780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-59a8af42-ceae-4c16-ac41-f663f0dad8ae tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.151468 Oct 04 09:04:09.297351 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 570/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:09 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:10.319869 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:10.320413 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:10.322346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:10.323030 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=6 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:10.328279 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:10.328761 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:10.329199 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:10.329888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:10.330342 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:10.330797 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:10.464496 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:10.472282 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-43dbbce4-4a47-44ad-b41b-38acb0d39985 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.156497 Oct 04 09:04:10.472853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 578/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:10 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:11.495589 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:11.496870 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:11.504208 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:11.504696 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:11.505137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:11.505840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:11.506304 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:11.506759 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:11.639341 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:11.647313 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f0e86a9b-8dd1-43d8-9694-02ea15cbf3c0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.155688 Oct 04 09:04:11.647813 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 571/1149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:11 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:12.670055 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:12.670610 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:12.677069 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:12.677549 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:12.677980 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:12.678692 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:12.679143 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:12.679593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:12.807036 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:12.815214 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-4771d231-eba0-4c54-82ce-afb1a831e1df tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.149243 Oct 04 09:04:12.816006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 579/1150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:12 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:13.170792 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-9d63cb12-72c6-482b-99d4-9587a05bf718 req-61785526-cc0b-4b99-8493-69ae2a064698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a37cf74c-826b-45a7-b571-2dc3e1cf3e7c", "name": "network-vif-plugged", "status": "completed", "tag": "4db9d8fe-2df7-4990-8b7d-450dd46d8043"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:13.180239 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-9d63cb12-72c6-482b-99d4-9587a05bf718 req-61785526-cc0b-4b99-8493-69ae2a064698 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:13.180715 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-9d63cb12-72c6-482b-99d4-9587a05bf718 req-61785526-cc0b-4b99-8493-69ae2a064698 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:13.181142 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-9d63cb12-72c6-482b-99d4-9587a05bf718 req-61785526-cc0b-4b99-8493-69ae2a064698 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:13.192886 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-9d63cb12-72c6-482b-99d4-9587a05bf718 req-61785526-cc0b-4b99-8493-69ae2a064698 service nova] Creating event network-vif-plugged:4db9d8fe-2df7-4990-8b7d-450dd46d8043 for instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c on hv-cinder-85944 Oct 04 09:04:13.197896 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-9d63cb12-72c6-482b-99d4-9587a05bf718 req-61785526-cc0b-4b99-8493-69ae2a064698 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153141 Oct 04 09:04:13.198663 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 572/1151] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:04:13.838999 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:13.839529 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:13.846726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:13.847215 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:13.847646 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:13.848325 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:13.848793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:13.849190 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:13.982647 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:13.990341 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-ac282553-60d7-4381-9c88-fa3224a2a526 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1264 microversion: 2.1 time: 0.155277 Oct 04 09:04:13.990945 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 580/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:13 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:15.014265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:15.015032 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:15.021415 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:15.021900 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:15.022361 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:15.023085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:15.023545 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:15.023975 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:15.152200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:15.160052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a814d848-157a-46db-ba2d-a1ebec8fd66c tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1451 microversion: 2.1 time: 0.151181 Oct 04 09:04:15.160653 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 573/1153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:15 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:15.185732 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:04:15.186432 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:04:15.192813 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:15.193290 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:15.193729 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:15.194438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:15.194888 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:15.195312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:15.327784 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:04:15.335942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8032977a-4916-45ae-86fa-40110fef9cdc tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1451 microversion: 2.1 time: 0.154831 Oct 04 09:04:15.336548 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 581/1154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:04:15 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:04:17.236954 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-73cb1048-0952-4fab-89a7-94f0038c0e6d req-3555913b-7b57-4ab8-b37b-1711e0834063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a37cf74c-826b-45a7-b571-2dc3e1cf3e7c", "tag": "4db9d8fe-2df7-4990-8b7d-450dd46d8043"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:04:17.246698 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-73cb1048-0952-4fab-89a7-94f0038c0e6d req-3555913b-7b57-4ab8-b37b-1711e0834063 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:04:17.248265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-73cb1048-0952-4fab-89a7-94f0038c0e6d req-3555913b-7b57-4ab8-b37b-1711e0834063 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:04:17.248265 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-73cb1048-0952-4fab-89a7-94f0038c0e6d req-3555913b-7b57-4ab8-b37b-1711e0834063 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:04:17.259028 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-73cb1048-0952-4fab-89a7-94f0038c0e6d req-3555913b-7b57-4ab8-b37b-1711e0834063 service nova] Creating event network-changed:4db9d8fe-2df7-4990-8b7d-450dd46d8043 for instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c on hv-cinder-85944 Oct 04 09:04:17.264584 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-73cb1048-0952-4fab-89a7-94f0038c0e6d req-3555913b-7b57-4ab8-b37b-1711e0834063 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031352 Oct 04 09:04:17.265554 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 574/1155] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:05:52.976791 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:52.978183 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=72 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:52.983017 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1093588519", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-850828242", "security_groups": [{"name": "tempest-secgroup-smoke-901326654"}], "block_device_mapping_v2": [{"uuid": "d8554168-f34c-4055-8b7d-9ef07201a1d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a74c7fc7-ef7f-4524-af4b-bb7156e889af"}]}} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:05:53.095438 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.network.neutron [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] validate_networks() for [('a74c7fc7-ef7f-4524-af4b-bb7156e889af', None, None, None, None, None)] {{(pid=127548) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 09:05:53.468194 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Flavor limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 09:05:53.468629 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Image limits 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 09:05:53.469115 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Flavor pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 09:05:53.469527 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Image pref 0:0:0 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 09:05:53.469972 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.virt.hardware [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 09:05:53.479016 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:53.479583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:53.480061 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:53.480812 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:53.481271 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:53.481726 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:53.498219 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Getting quotas for project 07b9220d86234adc83ef7fbe0d4d834d. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 09:05:53.501989 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.quota [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Getting quotas for user 471299b556bd4c22b51defc14b49d8eb and project 07b9220d86234adc83ef7fbe0d4d834d. Resources: {'ram', 'cores', 'instances'} {{(pid=127548) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 09:05:53.558132 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Going to run 1 instances... {{(pid=127548) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 09:05:53.560239 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d8554168-f34c-4055-8b7d-9ef07201a1d0',volume_size=None,volume_type=None)] {{(pid=127548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 09:05:53.877622 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-296f40d3-01a9-448a-a18c-633d2051eb60 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.902256 Oct 04 09:05:53.878317 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 582/1156] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Oct 4 09:05:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 09:05:53.888603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:53.889397 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:53.890135 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:05:53.890278 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Tue Oct 4 09:05:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 (ip 10.222.0.27) !!! Oct 04 09:05:53.892072 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:05:53.892194 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Tue Oct 4 09:05:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 (ip 10.222.0.27) !!! Oct 04 09:05:53.899428 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e741c419-2e60-4eb9-81d5-e41e8f16c468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:53.900193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e741c419-2e60-4eb9-81d5-e41e8f16c468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:53.957499 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e741c419-2e60-4eb9-81d5-e41e8f16c468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:53.965603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e741c419-2e60-4eb9-81d5-e41e8f16c468 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1094 microversion: 2.1 time: 0.078362 Oct 04 09:05:53.965603 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 575/1157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:53 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:54.986956 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:54.987598 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:54.994391 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:54.995003 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:54.995441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:54.996129 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:54.996580 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:54.997011 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:55.066982 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:55.075633 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f0f7886a-a3e7-46bb-ae7b-8a05aad58ed2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1136 microversion: 2.1 time: 0.092482 Oct 04 09:05:55.076312 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 583/1158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:54 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1136 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:56.099524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:56.100616 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:56.111326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:56.111326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:56.111326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:56.111326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:56.111718 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:56.112089 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:56.176022 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:56.183573 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-8308ba80-36ce-4b6d-998f-cd917d51e07e tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1210 microversion: 2.1 time: 0.088009 Oct 04 09:05:56.184137 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 576/1159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:56 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:05:57.216257 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:57.216871 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:57.223343 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:57.223829 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:57.224290 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:57.225018 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:57.225478 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:57.225910 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:57.359362 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:57.367168 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-f35ad4af-cb7d-4a47-a976-d495f7234085 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.154833 Oct 04 09:05:57.367744 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 584/1160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:57 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:57.582227 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-24dc6650-f02b-4ab5-beda-7f6a22359eab req-21a7a64d-cc5b-4020-978c-bf16ca90abbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa96806b-44ef-42a8-b8e6-334b588165c0", "tag": "b502cdd1-ec9d-4679-9c1f-351689220251"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:05:57.593580 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-24dc6650-f02b-4ab5-beda-7f6a22359eab req-21a7a64d-cc5b-4020-978c-bf16ca90abbe service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:57.601798 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-24dc6650-f02b-4ab5-beda-7f6a22359eab req-21a7a64d-cc5b-4020-978c-bf16ca90abbe service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:57.601798 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-24dc6650-f02b-4ab5-beda-7f6a22359eab req-21a7a64d-cc5b-4020-978c-bf16ca90abbe service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:57.606346 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-24dc6650-f02b-4ab5-beda-7f6a22359eab req-21a7a64d-cc5b-4020-978c-bf16ca90abbe service nova] Creating event network-changed:b502cdd1-ec9d-4679-9c1f-351689220251 for instance aa96806b-44ef-42a8-b8e6-334b588165c0 on hv-cinder-85944 Oct 04 09:05:57.611649 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-24dc6650-f02b-4ab5-beda-7f6a22359eab req-21a7a64d-cc5b-4020-978c-bf16ca90abbe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033161 Oct 04 09:05:57.612242 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 577/1161] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:05:58.391160 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:58.391666 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:58.398330 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:58.398848 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:58.399354 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:58.400201 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:58.400661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:58.401090 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:58.537019 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:58.545378 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-77dbd8ce-13bf-4c96-be8e-e2aa1e662971 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.158200 Oct 04 09:05:58.546131 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 585/1162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:58 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:05:59.569041 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:05:59.569734 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:05:59.575976 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:59.576456 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:59.576888 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:59.577563 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:05:59.578014 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:05:59.578454 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:05:59.933314 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:05:59.940859 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-f6d7297e-a03f-4bed-b0fe-15fdafdd5ccb tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.376603 Oct 04 09:05:59.941418 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 578/1163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:05:59 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:00.963725 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:00.968565 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:00.970782 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:00.971301 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:00.971744 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:00.972444 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:00.972903 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:00.973336 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:01.101815 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:01.110456 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-704458b2-b3df-4103-938e-7ea81186e1c4 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.150876 Oct 04 09:06:01.111016 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 586/1164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:00 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:02.133206 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:02.134847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:02.141074 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:02.141546 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:02.141976 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:02.142693 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:02.143139 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:02.143560 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:02.276247 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:02.283959 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-2a7caaa1-1284-4d5d-a76d-4713ffd3636f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.154742 Oct 04 09:06:02.284518 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 579/1165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:02 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:03.306758 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:03.307372 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:03.313796 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:03.314283 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:03.314759 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:03.315457 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:03.315909 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:03.316346 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:03.443661 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:03.451937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-c31e2fd2-39a2-42e5-86fa-454685968ac7 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.149308 Oct 04 09:06:03.452500 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 587/1166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:03 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:04.475931 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:04.476530 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:04.479536 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell0:SELECT=2 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:04.484323 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:04.484800 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:04.485236 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:04.485917 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:04.486366 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:04.486818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:04.623031 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:04.630971 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-e5ea3b9e-876d-4ff2-94b5-eb3da310425d tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.158956 Oct 04 09:06:04.631530 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 580/1167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:04 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:05.653982 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:05.654714 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:05.656528 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=2 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:05.657333 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell0:SELECT=6 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:05.662498 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:05.668508 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:05.668508 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:05.668508 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:05.668508 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:05.668891 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:05.797322 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:05.805179 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-e8072071-7c5a-40b2-9688-2b05af98efc8 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.155102 Oct 04 09:06:05.805759 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 588/1168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:05 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:06.878811 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:06.879510 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:06.886169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:06.886685 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:06.887134 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:06.887835 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:06.888300 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:06.888731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:07.020908 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:07.029369 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-07ac0489-197a-415b-9e60-d8454975bd13 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.206070 Oct 04 09:06:07.032754 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 581/1169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:06 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:07.581641 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-bb6e9c6e-cf4b-408e-8db6-119b78c5b343 req-6dcab480-8258-434e-9370-35e87efcd14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa96806b-44ef-42a8-b8e6-334b588165c0", "name": "network-vif-plugged", "status": "completed", "tag": "b502cdd1-ec9d-4679-9c1f-351689220251"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:07.596435 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bb6e9c6e-cf4b-408e-8db6-119b78c5b343 req-6dcab480-8258-434e-9370-35e87efcd14c service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:07.596923 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bb6e9c6e-cf4b-408e-8db6-119b78c5b343 req-6dcab480-8258-434e-9370-35e87efcd14c service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:07.597389 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-bb6e9c6e-cf4b-408e-8db6-119b78c5b343 req-6dcab480-8258-434e-9370-35e87efcd14c service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:07.614311 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-bb6e9c6e-cf4b-408e-8db6-119b78c5b343 req-6dcab480-8258-434e-9370-35e87efcd14c service nova] Creating event network-vif-plugged:b502cdd1-ec9d-4679-9c1f-351689220251 for instance aa96806b-44ef-42a8-b8e6-334b588165c0 on hv-cinder-85944 Oct 04 09:06:07.619728 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-bb6e9c6e-cf4b-408e-8db6-119b78c5b343 req-6dcab480-8258-434e-9370-35e87efcd14c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042603 Oct 04 09:06:07.620330 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 589/1170] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:06:08.052337 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:08.052952 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:08.059589 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:08.060081 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:08.060525 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:08.061302 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:08.061761 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:08.062193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:08.193606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:08.201422 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-72472e79-e14d-4117-9847-5d1c529c7961 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1265 microversion: 2.1 time: 0.152990 Oct 04 09:06:08.201994 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 582/1171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:08 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:09.225153 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:09.225776 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:09.232973 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:09.233463 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:09.233907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:09.234632 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:09.235100 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:09.235530 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:09.372970 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:09.381217 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-965ce97f-6d4a-4458-a8a6-622034be01a6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1453 microversion: 2.1 time: 0.160328 Oct 04 09:06:09.381954 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 590/1172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:09 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:09.404042 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:06:09.404659 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:06:09.411049 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:09.411538 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:09.412662 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:09.412818 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:09.413150 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:09.413606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:09.549994 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:06:09.559622 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-debee807-99ad-42d6-ae8b-62b80f18ed8f tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1453 microversion: 2.1 time: 0.159370 Oct 04 09:06:09.560292 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 583/1173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:06:09 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:06:11.391906 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-23b15c50-705b-45c7-9237-7b001a13d0f9 req-029dcec9-9a28-42d6-9ae8-870bfa896488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa96806b-44ef-42a8-b8e6-334b588165c0", "tag": "b502cdd1-ec9d-4679-9c1f-351689220251"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:06:11.402785 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-23b15c50-705b-45c7-9237-7b001a13d0f9 req-029dcec9-9a28-42d6-9ae8-870bfa896488 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:06:11.403348 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-23b15c50-705b-45c7-9237-7b001a13d0f9 req-029dcec9-9a28-42d6-9ae8-870bfa896488 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:06:11.403853 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-23b15c50-705b-45c7-9237-7b001a13d0f9 req-029dcec9-9a28-42d6-9ae8-870bfa896488 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:06:11.419113 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-23b15c50-705b-45c7-9237-7b001a13d0f9 req-029dcec9-9a28-42d6-9ae8-870bfa896488 service nova] Creating event network-changed:b502cdd1-ec9d-4679-9c1f-351689220251 for instance aa96806b-44ef-42a8-b8e6-334b588165c0 on hv-cinder-85944 Oct 04 09:06:11.424359 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-23b15c50-705b-45c7-9237-7b001a13d0f9 req-029dcec9-9a28-42d6-9ae8-870bfa896488 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036319 Oct 04 09:06:11.425048 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 591/1174] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:07:42.724922 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:42.730238 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG dbcounter [-] [127548] Writing DB stats nova_cell1:SELECT=48 {{(pid=127548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:42.730395 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:42.730878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 09:07:42.730878 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Tue Oct 4 09:07:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 04 09:07:42.731085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:42.731085 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_api:SELECT=20 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:42.731984 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG dbcounter [-] [127549] Writing DB stats nova_cell1:SELECT=44 {{(pid=127549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:42.739963 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:42.740566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:42.741067 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:42.741863 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:42.742387 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:42.742940 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:42.771379 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Going to try to terminate instance {{(pid=127549) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:07:42.798828 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-f366a72c-17c2-42af-812f-5fff09ee7237 req-1b74bcfe-92cf-403d-b540-a7e56b8fea07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa96806b-44ef-42a8-b8e6-334b588165c0", "tag": "b502cdd1-ec9d-4679-9c1f-351689220251"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:42.809475 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f366a72c-17c2-42af-812f-5fff09ee7237 req-1b74bcfe-92cf-403d-b540-a7e56b8fea07 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:42.820393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f366a72c-17c2-42af-812f-5fff09ee7237 req-1b74bcfe-92cf-403d-b540-a7e56b8fea07 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:42.820393 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-f366a72c-17c2-42af-812f-5fff09ee7237 req-1b74bcfe-92cf-403d-b540-a7e56b8fea07 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:42.821960 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-f366a72c-17c2-42af-812f-5fff09ee7237 req-1b74bcfe-92cf-403d-b540-a7e56b8fea07 service nova] Creating event network-changed:b502cdd1-ec9d-4679-9c1f-351689220251 for instance aa96806b-44ef-42a8-b8e6-334b588165c0 on hv-cinder-85944 Oct 04 09:07:42.827353 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-f366a72c-17c2-42af-812f-5fff09ee7237 req-1b74bcfe-92cf-403d-b540-a7e56b8fea07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104111 Oct 04 09:07:42.827949 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 592/1175] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:07:43.354144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cebe7ea4-a5d1-4837-8d48-1a4dfca3fd94 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 204 len: 0 microversion: 2.1 time: 0.633021 Oct 04 09:07:43.354777 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 584/1176] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 09:07:42 2022] DELETE /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:07:43.364291 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:43.365024 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:43.372090 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:43.372583 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:43.373017 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:43.373764 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:43.374216 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:43.374660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:43.513006 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:43.521330 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-9aeb4b78-2248-4564-b2e3-d6a0c8e9dddd tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1578 microversion: 2.1 time: 0.161717 Oct 04 09:07:43.521916 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 593/1177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:43 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:44.545144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:44.545840 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:44.553257 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:44.553738 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:44.554169 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:44.554878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:44.555326 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:44.555745 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:44.689026 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:44.696748 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cb2a11b8-edbb-4963-ab81-e52d97669ed6 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1459 microversion: 2.1 time: 0.156085 Oct 04 09:07:44.697878 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 585/1178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:44 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:45.711644 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [req-5d793c8a-d92c-494b-9965-61beb20fc469 req-23036202-54c6-4b66-a7a2-f2f70a78f60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa96806b-44ef-42a8-b8e6-334b588165c0", "name": "network-vif-deleted", "tag": "b502cdd1-ec9d-4679-9c1f-351689220251"}]} {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:45.715681 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5d793c8a-d92c-494b-9965-61beb20fc469 req-23036202-54c6-4b66-a7a2-f2f70a78f60b service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:45.716157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5d793c8a-d92c-494b-9965-61beb20fc469 req-23036202-54c6-4b66-a7a2-f2f70a78f60b service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:45.716588 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [req-5d793c8a-d92c-494b-9965-61beb20fc469 req-23036202-54c6-4b66-a7a2-f2f70a78f60b service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:45.720450 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:45.721061 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:45.727719 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:45.727897 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.compute.server_external_events [req-5d793c8a-d92c-494b-9965-61beb20fc469 req-23036202-54c6-4b66-a7a2-f2f70a78f60b service nova] Creating event network-vif-deleted:b502cdd1-ec9d-4679-9c1f-351689220251 for instance aa96806b-44ef-42a8-b8e6-334b588165c0 on hv-cinder-85944 Oct 04 09:07:45.728200 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:45.729290 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:45.729978 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:45.730442 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:45.730867 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:45.733517 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [req-5d793c8a-d92c-494b-9965-61beb20fc469 req-23036202-54c6-4b66-a7a2-f2f70a78f60b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032237 Oct 04 09:07:45.734105 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 594/1179] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:07:45.798524 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:45.806193 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-717d6ec2-fa82-4c28-9cb1-d0b6d49d4600 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1392 microversion: 2.1 time: 0.089813 Oct 04 09:07:45.806945 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 586/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:45 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1392 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:46.830675 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:46.831415 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:46.837455 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:46.837942 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:46.838382 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:46.839117 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:46.839632 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:46.840064 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:46.879994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:46.880483 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:46.880926 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:46.881379 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.objects.instance [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lazy-loading 'fault' on Instance uuid aa96806b-44ef-42a8-b8e6-334b588165c0 {{(pid=127548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 09:07:46.928907 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:46.937304 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-a1af4731-20ae-4879-9b4b-0777b83ba770 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 200 len: 1230 microversion: 2.1 time: 0.112244 Oct 04 09:07:46.937881 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 595/1181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:46 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:47.959614 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:47.960255 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: aa96806b-44ef-42a8-b8e6-334b588165c0] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:47.966734 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:47.967219 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:47.967656 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:47.968356 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:47.968810 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:47.969235 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:47.983240 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] HTTP exception thrown: Instance aa96806b-44ef-42a8-b8e6-334b588165c0 could not be found. Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Request method failure captured: Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 HTTP/1.1 Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_ZKdBHVlzvS_rk8n0iIGiFzMrbix4Aafy5xuDxpbhb7oxf9D9p2AyJSDwFtGYmyqJBKPHw9WWSt3caf79JT0QZSPf6gJ_Ssy2z4utZl29EIof42YTnoIa2PLqP-FexAYNC5E0JrkwUJnkbLPpURGoCHHEE-u0Wld-2pZflCdaKdzxk Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 09:07:47.989606 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07b9220d86234adc83ef7fbe0d4d834d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 471299b556bd4c22b51defc14b49d8eb Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance aa96806b-44ef-42a8-b8e6-334b588165c0 could not be found. Oct 04 09:07:47.991408 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'aa96806b-44ef-42a8-b8e6-334b588165c0'} Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa96806b-44ef-42a8-b8e6-334b588165c0 could not be found. Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:07:47.992412 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa96806b-44ef-42a8-b8e6-334b588165c0 could not be found. Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa96806b-44ef-42a8-b8e6-334b588165c0 could not be found. Oct 04 09:07:47.994658 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:47.996236 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Returning 404 to user: Instance aa96806b-44ef-42a8-b8e6-334b588165c0 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:07:47.996236 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-a9a702e7-2513-4da9-8521-a8d82644ed45 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0" status: 404 len: 111 microversion: 2.1 time: 0.030498 Oct 04 09:07:47.996236 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 587/1182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:47 2022] GET /compute/v2.1/servers/aa96806b-44ef-42a8-b8e6-334b588165c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:07:51.599612 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:51.600142 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:51.601472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-55cede7a-8702-471a-b892-fac17afc0b81 req-9da2a17a-7b49-4f19-ad51-0d3444eff776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a37cf74c-826b-45a7-b571-2dc3e1cf3e7c", "tag": "4db9d8fe-2df7-4990-8b7d-450dd46d8043"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:51.606652 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:51.607132 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:51.608218 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:51.609139 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:51.609371 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:51.609794 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:51.612780 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-55cede7a-8702-471a-b892-fac17afc0b81 req-9da2a17a-7b49-4f19-ad51-0d3444eff776 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:51.613335 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-55cede7a-8702-471a-b892-fac17afc0b81 req-9da2a17a-7b49-4f19-ad51-0d3444eff776 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:51.613969 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-55cede7a-8702-471a-b892-fac17afc0b81 req-9da2a17a-7b49-4f19-ad51-0d3444eff776 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:51.625638 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-55cede7a-8702-471a-b892-fac17afc0b81 req-9da2a17a-7b49-4f19-ad51-0d3444eff776 service nova] Creating event network-changed:4db9d8fe-2df7-4990-8b7d-450dd46d8043 for instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c on hv-cinder-85944 Oct 04 09:07:51.632253 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-55cede7a-8702-471a-b892-fac17afc0b81 req-9da2a17a-7b49-4f19-ad51-0d3444eff776 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034603 Oct 04 09:07:51.632923 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 588/1183] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 09:07:51.635593 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Going to try to terminate instance {{(pid=127548) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 09:07:52.018984 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-33f28855-1dad-4b2c-a495-c7d695473330 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 204 len: 0 microversion: 2.1 time: 0.423187 Oct 04 09:07:52.020074 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 596/1184] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 09:07:51 2022] DELETE /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 09:07:52.029342 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:52.030706 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:52.037291 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:52.037785 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:52.038222 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:52.038960 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:52.039420 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:52.039852 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:52.174078 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.policy [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127549) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:52.182154 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-b72c7ff7-b8df-45aa-a67e-baae89a582a2 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1575 microversion: 2.1 time: 0.157227 Oct 04 09:07:52.182752 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 589/1185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:52 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 09:07:53.206299 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:53.207042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:53.213447 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:53.213937 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:53.214380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:53.215098 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:53.215558 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:53.215994 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:53.352157 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:53.360195 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-77ddb6c1-0aa9-4bb7-9600-f1547be602f0 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1457 microversion: 2.1 time: 0.158774 Oct 04 09:07:53.360767 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 597/1186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:53 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:53.985266 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [req-99ef5138-8768-43d3-9671-a66230366649 req-6f93ee6e-1942-47f6-be5e-1e6d90dd0d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a37cf74c-826b-45a7-b571-2dc3e1cf3e7c", "name": "network-vif-deleted", "tag": "4db9d8fe-2df7-4990-8b7d-450dd46d8043"}]} {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 09:07:53.998591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-99ef5138-8768-43d3-9671-a66230366649 req-6f93ee6e-1942-47f6-be5e-1e6d90dd0d18 service nova] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:53.998591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-99ef5138-8768-43d3-9671-a66230366649 req-6f93ee6e-1942-47f6-be5e-1e6d90dd0d18 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:53.998591 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [req-99ef5138-8768-43d3-9671-a66230366649 req-6f93ee6e-1942-47f6-be5e-1e6d90dd0d18 service nova] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:54.007469 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.compute.server_external_events [req-99ef5138-8768-43d3-9671-a66230366649 req-6f93ee6e-1942-47f6-be5e-1e6d90dd0d18 service nova] Creating event network-vif-deleted:4db9d8fe-2df7-4990-8b7d-450dd46d8043 for instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c on hv-cinder-85944 Oct 04 09:07:54.012476 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [req-99ef5138-8768-43d3-9671-a66230366649 req-6f93ee6e-1942-47f6-be5e-1e6d90dd0d18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031749 Oct 04 09:07:54.013052 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 590/1187] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Oct 4 09:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 09:07:54.383889 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:54.384498 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:54.391386 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:54.391792 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:54.392238 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:54.392941 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:54.393398 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:54.394441 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:54.457107 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.policy [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '471299b556bd4c22b51defc14b49d8eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b9220d86234adc83ef7fbe0d4d834d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127548) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 09:07:54.464866 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-cafe420c-9a86-44ad-a04f-e9973029ab34 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 200 len: 1224 microversion: 2.1 time: 0.084826 Oct 04 09:07:54.465429 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 598/1188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:54 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 09:07:55.491232 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:55.491847 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: a37cf74c-826b-45a7-b571-2dc3e1cf3e7c] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:55.498144 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:55.498727 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:55.499160 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:55.500566 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:55.501058 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:55.501470 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:55.514776 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] HTTP exception thrown: Instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c could not be found. Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Request method failure captured: Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c HTTP/1.1 Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_ZKdBHVlzvS_rk8n0iIGiFzMrbix4Aafy5xuDxpbhb7oxf9D9p2AyJSDwFtGYmyqJBKPHw9WWSt3caf79JT0QZSPf6gJ_Ssy2z4utZl29EIof42YTnoIa2PLqP-FexAYNC5E0JrkwUJnkbLPpURGoCHHEE-u0Wld-2pZflCdaKdzxk Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 09:07:55.516372 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07b9220d86234adc83ef7fbe0d4d834d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 471299b556bd4c22b51defc14b49d8eb Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c could not be found. Oct 04 09:07:55.518115 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': 'a37cf74c-826b-45a7-b571-2dc3e1cf3e7c'} Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c could not be found. Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:07:55.519095 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c could not be found. Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c could not be found. Oct 04 09:07:55.521038 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:55.522714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Returning 404 to user: Instance a37cf74c-826b-45a7-b571-2dc3e1cf3e7c could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:07:55.522714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-cd0052cf-109c-40e9-b376-a8aec9127754 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c" status: 404 len: 111 microversion: 2.1 time: 0.031356 Oct 04 09:07:55.522714 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 591/1189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:55 2022] GET /compute/v2.1/servers/a37cf74c-826b-45a7-b571-2dc3e1cf3e7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:07:56.045747 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:56.046246 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.compute.api [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127548) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:56.053242 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:56.053736 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:56.054177 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:56.054899 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:56.055356 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:56.055787 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG oslo_concurrency.lockutils [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:56.069042 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.wsgi [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] HTTP exception thrown: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Request method failure captured: Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: request: DELETE /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 HTTP/1.1 Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept: application/json Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Accept-Encoding: identity Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Connection: close Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Length: 0 Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Content-Type: application/json Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Host: 10.222.0.27 Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: Openstack-System-Scope: None Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: User-Agent: python-urllib3/1.26.12 Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Auth-Token: gAAAAABjO_ZKdBHVlzvS_rk8n0iIGiFzMrbix4Aafy5xuDxpbhb7oxf9D9p2AyJSDwFtGYmyqJBKPHw9WWSt3caf79JT0QZSPf6gJ_Ssy2z4utZl29EIof42YTnoIa2PLqP-FexAYNC5E0JrkwUJnkbLPpURGoCHHEE-u0Wld-2pZflCdaKdzxk Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Id: None Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Domain-Name: None Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Identity-Status: Confirmed Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Is-Admin-Project: True Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Id: default Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Domain-Name: Default Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Project-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Role: reader,member Oct 04 09:07:56.070733 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Roles: reader,member Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07b9220d86234adc83ef7fbe0d4d834d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-Tenant-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Id: default Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Domain-Name: Default Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Id: 471299b556bd4c22b51defc14b49d8eb Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: X-User-Name: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: method: > Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: exception: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.072399 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: action_args: {'id': '710ef0a9-6fc5-4e69-9e08-aef2fe6f3944'} Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:07:56.073380 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.075114 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.076793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Returning 404 to user: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. {{(pid=127548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:07:56.076793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-b33de70c-eaad-4725-a517-9011b40db1e1 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "DELETE /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 404 len: 111 microversion: 2.1 time: 0.030214 Oct 04 09:07:56.076793 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 599/1190] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Oct 4 09:07:56 2022] DELETE /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:07:56.080797 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '>' {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:56.081415 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.compute.api [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] [instance: 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944] Fetching instance by UUID {{(pid=127549) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 09:07:56.087316 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:56.087790 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:56.088223 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:56.088904 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Acquiring lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 09:07:56.089353 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 09:07:56.089778 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG oslo_concurrency.lockutils [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Lock "e1cf7a9b-8077-4fd8-a759-81fb5750f051" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 09:07:56.103472 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.wsgi [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] HTTP exception thrown: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Request method failure captured: Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: request: GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 HTTP/1.1 Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept: application/json Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Accept-Encoding: identity Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Connection: close Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Length: 0 Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Content-Type: application/json Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Host: 10.222.0.27 Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: Openstack-System-Scope: None Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: User-Agent: python-urllib3/1.26.12 Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Auth-Token: gAAAAABjO_ZKdBHVlzvS_rk8n0iIGiFzMrbix4Aafy5xuDxpbhb7oxf9D9p2AyJSDwFtGYmyqJBKPHw9WWSt3caf79JT0QZSPf6gJ_Ssy2z4utZl29EIof42YTnoIa2PLqP-FexAYNC5E0JrkwUJnkbLPpURGoCHHEE-u0Wld-2pZflCdaKdzxk Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Id: None Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Domain-Name: None Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Identity-Status: Confirmed Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Is-Admin-Project: True Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Id: default Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Domain-Name: Default Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Project-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Role: reader,member Oct 04 09:07:56.104965 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Roles: reader,member Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_07b9220d86234adc83ef7fbe0d4d834d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/07b9220d86234adc83ef7fbe0d4d834d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}] Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Id: 07b9220d86234adc83ef7fbe0d4d834d Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-Tenant-Name: tempest-TestVolumeBootPattern-205612545 Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Id: default Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Domain-Name: Default Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Id: 471299b556bd4c22b51defc14b49d8eb Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: X-User-Name: tempest-TestVolumeBootPattern-205612545-project Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: method: > Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: exception: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.106796 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: action_args: {'id': '710ef0a9-6fc5-4e69-9e08-aef2fe6f3944'} Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: {{(pid=127549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 09:07:56.107731 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. Oct 04 09:07:56.109962 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: ERROR nova.api.openstack.wsgi Oct 04 09:07:56.111455 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: DEBUG nova.api.openstack.wsgi [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Returning 404 to user: Instance 710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 could not be found. {{(pid=127549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 09:07:56.111455 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: INFO nova.api.openstack.requestlog [None req-3d22c998-bb91-4577-8e23-437b57931269 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944" status: 404 len: 111 microversion: 2.1 time: 0.029320 Oct 04 09:07:56.111455 dv-cinder-859447-2-iscsi devstack@n-api.service[127549]: [pid: 127549|app: 0|req: 592/1191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Oct 4 09:07:56 2022] GET /compute/v2.1/servers/710ef0a9-6fc5-4e69-9e08-aef2fe6f3944 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 09:07:57.697080 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: DEBUG nova.api.openstack.wsgi [None req-8c11050d-70fa-4fa4-a5e3-17fcf5362421 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] Calling method '.version_select at 0x7f6f1a6151f0>' {{(pid=127548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 09:07:57.890660 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: INFO nova.api.openstack.requestlog [None req-8c11050d-70fa-4fa4-a5e3-17fcf5362421 tempest-TestVolumeBootPattern-205612545 tempest-TestVolumeBootPattern-205612545-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-850828242" status: 202 len: 0 microversion: 2.1 time: 0.197344 Oct 04 09:07:57.891247 dv-cinder-859447-2-iscsi devstack@n-api.service[127548]: [pid: 127548|app: 0|req: 600/1192] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Oct 4 09:07:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-850828242 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)